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Executive  Summary 

The  objective  of  this  research  is  to  develop  a  technique  to  integrate  structure  and  con¬ 
trol  design  with  applications  to  the  Phillips  Lab  Laser  Crosslink  Structure  (LCS).  This 
structure  acts  as  a  mounting  frame  for  a  proposed  laser-based  communications  system 
attached  to  a  DSP  surveillance  satellite;  the  laser  system  is  part  of  a  planned  upgrade 
from  the  radio-based  system  currently  employed.  Since  the  laser-based  communications 
system  is  about  ten  times  more  sensitive  to  transmitter /receiver  line-of-sight  errors  than 
the  current  communications  system,  an  active  vibration  control  system  is  necessary.  The 
goal  of  this  investigation  is  to  redesign  the  LCS  and  an  appropriate  controller  simultane¬ 
ously  so  that  the  vibration  imparted  to  the  structure  by  the  satellite  is  compensated  for 
by  the  control  system,  thus  facilitating  communications.  The  results  may  be  summarized 
as  follows: 

1.  A  finite  element  model  of  the  LCS  was  developed  for  the  Phillips  TRW  design.  The 
freedom  in  this  model  includes  mass  density  of  the  composite  tubes,  modulus  of 
elasticity,  cross  sectional  area  (representing  the  number  of  wraps  of  the  composite 
material),  and  the  length  of  each  finite  element.  A  new  finite  element  is  developed 
to  incorporate  induced  strain  actuation  for  any  given  beam  and  piezoelectric  cross- 
section  geometries.  The  controller  design  freedom  is  the  variance  upper  bounds 
allowed  in  the  pointing  errors  for  the  laser,  in  the  presence  of  noisy  disturbances 
from  the  spacecraft. 

2.  An  algorithm  is  developed  to  optimally  choose  the  parameters  in  both  the  struc¬ 
ture  and  the  controller.  The  algorithm  is  guaranteed  to  converge  to  the  optimal 
solution.  This  is  believed  to  be  the  first  solution  to  a  nonlinear  programming  prob¬ 
lem  integrating  structure  and  control  designs.  Past  approaches  have  only  given 
necessary  conditions. 

3.  The  results  of  the  LCS  redesign  when  compared  to  the  original  Phillips /TRW  design 
for  the  same  variance  performances: 

—  savings  of  22%  mass  of  composite  structure 

—  savings  of  32%  control  energy 

—  the  mass  is  not  directly  penalized  in  the  design,  but  it  is  indirectly  penalized 
by  minimizing  control  energy  (for  a  given  performance  constraint,  it  is  easier 
to  push  around  small  mass) 
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4.  Softwaxe  is  developed  to  solve  this  generic  problem  which  we  call  Optimal  Mix  of 
Passive  and  Active  Control  (OMPAC). 

5.  The  set  of  all  stabilizing  combinations  of  structural  parameters,  piezoelectric  me¬ 
chanical  and  electrical  properties,  and  control  parameters  have  been  characterized. 
For  the  LCS  structure  this  allows  the  parametrization  of  stabilizing  control  gains 
as  a  function  of  the  composite  tube  cross-sectional  areas,  the  location  and  dimen¬ 
sions  of  the  piezoelectric  aetuators,  and  the  electrical/mechauical  properties  of  the 
actuator. 

6.  Covariance  controllers  are  derived  for  those  applications  when  desired  covariances 
are  known,  or  when  upperbounds  on  the  output  covariance  matrix  is  specified. 

7.  These  results  were  very  helpful  as  a  starting  point  for  other  DOD  research  to  extend 
the  optimization  beyond  the  covariance  performance  criteria  of  this  grant  (F49620- 
92-0202)  to  include  H2/H00  criteria. 

In  conclusion,  this  research  has  taken  a  giant  step  toward  the  creation  of  a  scientific 
procedure  for  the  DESIGN  process  where  the  space  structure  and  the  controller  are 
optimized  together  as  a  system. 
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A.  Mathematical  Models  of  Laser  Crosslink 
Structure 


A.  Mathematical  Models  of  Laser  Crosslink  Structure 


Introduction: 

The  LCS  is  a  support  structure,  connected  to  a  spacecraft,  and  designed  to  support  a 
laser  weapon.  It  is  required  that  the  structure  be  actively  controlled  so  as  to  attenuate 
the  spacecraft-induced  disturbances  to  assure  the  highest  pointing  accuracy  possible  for 
the  laser  beam. 

Design  Requirements: 

The  LCS  control  problem  is  to  guarantee  an  absolute  bound  on  the  line  of  sight  pointing 
error  in  the  presence  of  a  class  of  uncertain  disturbances  having  a  known  energy  bound. 
The  free  design  parameters  are  the  material  properties  of  the  truss  members  and  the 
dynamics  of  the  controller. 


Objective 

Simultaneously  choose  the  structural  the  actuator,  the  sensor  and  the  control  design 
parameters  to  minimize  the  active  control  energy  required  to  accomplish  the  overall  sys¬ 
tem  design  requirements.  One  of  the  contributions  of  this  research  is  to  develop  a  theory 
for  design,  deducing  design  requirements  for  each  component  of  a  system,  given  overall 
system  performance  requirements.  Finally  a  workstation  environment  for  rapid  design  is 
sought. 

I.  Finite  Element  Modeling  of  the  Laser  Crosslink  Structure 

We  have  developed  a  finite  element  model  of  the  laser  crosslink  structure  (LCS)  to  be 
built  by  Phillips  Labs,  using  only  the  six  structure  members  which  significantly  influence 
the  motion  of  the  laser  platform.  Figure  1  shows  a  view  of  the  LCS  and  it  also  depicts 
the  crosslink  structure  idealization  used  to  develop  finite  element  models  of  the  LCS.  We 
have  made  several  assumptions  in  order  to  develop  our  LCS  finite  element  model,  and 
these  assumptions  are  as  follows: 


4 


(1)  The  LCS  can  be  modeled  as  a  truss. 

(2)  Each  structure  member  is  uniform  in  composition  and  shape.  This  assumption 
excluded  modeling  the  effects  of  the  end  sleeves  and  fitting  blades  to  the  structure 
dynamics. 

(3)  Mechanical  damping  is  a  function  of  the  mass  and  stiffness  matrices  of  the  FEM,  i. 
e.,  we  assume  Rayleigh  damping. 

Although  we  have  written  software  to  assemble  the  mass  and  stiffness  matrices  of 
an  LCS  finite  element  model,  we  have  yet  to  include  in  our  model  the  dynamics  of 
piezo-electric  materials  we  assume  will  be  imbedded  into  the  structure  members  to  act  as 
actuating  devices.  See  Appendix  A  for  more  information  about  the  LCS. 

Our  investigation  of  the  LCS  finite  element  modeling  will  consider  three  key 
modeling  parameters  that  will  affect  the  control  system  design  and  the  LCS  redesign;  the 
number  of  finite  elements  used  to  model  each  structure  member,  the  type  of  finite 
element,  and  the  length  of  each  finite  element. 

n.  Integrating  Structure  and  Control  Design:  An  Example 

To  illustrate  our  procedure,  we  begin  with  a  single  truss  member.  We  shall  design 
the  member  so  that  the  design  helps  to  minimize  the  active  control  energy  required  to 
control  the  dynamics  of  the  structure  to  meet  required  performance  objectives.  In  this 
approach  we  consider  two  broad  issues  which  contribute  to  the  effectiveness  of  a  control 
design  to  meet  the  specified  objectives:  the  design  and  modeling  of  the  structure. 


6 


Truss  Member  Design 


The  choice  of  the  material  properties  and  the  truss  member  geometry  determine  the 
density,  elasticity,  cross-sectional  area,  and  length  of  each  truss  member.  When  we 
change  any  of  these  parameters  to  modify  truss  dynamics  performance,  the  process 
becomes  a  part  of  the  design  issue. 

TRUSS  MEMBER  DESIGN  PARAMETERS 


DENSITY 

P 

ELASTICITY 

E 

CROSS-SECTION  AREA 

A 

LENGTH  OF  THE  MEMBER 

L 

Note  that  a  truss  member  need  not  be  uniform  along  its  entire  length,  so  that  there  may  be 
sub-members  to  consider. 

Truss  Modeling 

If  we  assume  that  the  truss  dynamics  are  modeled  via  finite  element  methods,  the 
choice  of  the  number  of  finite  elements  modeling  each  member,  N,  the  type  of  finite 
elements  (denoted  by  the  degree  of  the  polynomial  describing  axial  displacement),  n,  and 
the  lengths  of  each  finite  element,  Lj,  are  considerations  in  the  modeling  process.  When 
we  change  any  of  these  parameters  to  modify  the  fidelity  of  the  truss  model,  the  process 
becomes  part  of  the  modeling  issue. 
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TRUSS  MEMBER  MODELING  PARAMETERS 


NUMBER  OF  FINITE  ELEMENTS  PER  MEMBER 

N 

TYPE  OF  ELEMENT 

n 

LENGTH  OF  EACH  FINITE  ELEMENT 

Lj 

In  order  to  determine  how  both  the  design  parameters  and  the  modeling  parameters  affect 
the  controller  design  issues,  we  considered  a  uniform,  tubular  LCS  truss  member 
depicted  by  Figure  2.  In  this  example  one  end  of  the  member  is  inertially  fixed.  The 
structure  was  controlled  with  minimum  energy,  assuming  that  the  structure  is  subject  to 
axial  control  forces  and  the  displacements  and  velocities  at  each  of  the  modeled  nodes 
{ui(t),  U2(t),  U3(t)}  are  the  only  measurements  available  to  the  control  system,  and  it  was 
desired  to  keep  these  displacements  within  specified  values.  The  control  force, 
was  applied  to  the  free  end  of  the  member.  In  the  development  of  the  finite  element 
model  of  the  member,  we  limited  the  scope  of  this  example  by  using  three  linear  finite 
elements  to  model  the  member  dynamics.  Thus  the  mass  and  stiffness  matrices  for  the 
three  finite  elements  are 


M,  = 

2  l' 

III 

J> 

1  -1 

^  6 

1  2 

^  Lj 

-1  1 

Rayleigh  damping  was  assumed  to  capture  the  dependence  of  damping  on  the  member 
mass  and  stiffness  matrices. 
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Table  1  gives  the  values  for  the  physical  properties  of  each  finite  element  of  the 
truss  member. 


Table  1 

Physical  properties  of  the  member 


OUTER  DIAMETER  (inches) 

1.050 

THICKNESS  (inches) 

0.050 

CROSS-SECTIONAL  AREA  (in^) 

0.0805 

ELASTICITY  (psi) 

16.0  X  lO^* 

DENSITY  (slugs/in^) 

1.3469  X  10“^ 

Rayleigh  damping  coefficients 
D  =  aM+pK 


a 

0.001 

p 

l.Oe-07 

One  way  to  integrate  the  design  and  modeling  problems  is  to  define  the  following  design 
parameters  for  this  example: 

Pj  =  Pj -^j f-j ’  j  ~  1»2,3 

EjAj 

=  j  =  1.2.3 
H 

where  the  sum  of  the  design  parameters  Lj ,  L2,  L3  is  fixed, 

L  =  Lj  +  L2  +  L3  . 

The  redesign  algorithm  begins  with  an  FEM  for  the  given  design, 
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iWu(t)  +  (afW  +  |3i^u(t)  +  :?Cu(t)  =  . 


Ul(t) 


u(t)  = 


U2(t) 


U3(t) 


and  a  control  law 


:rc=G 


u(t) 

U(t) 


which  meets  the  output  variance  constraints  (OVC); 


Juj^(T)dt<a/  ,  j=  1,2,3  . 
0 


The  OVC  constraints  used  in  this  example  are  given  in  Table  2. 


Table  2 

OVC  Bounds  for  the  truss  redesign  member  example 


4.7690e-08 

cl 

2.5888e-07 

cl 

2.7354e-07 

(1) 


The  redesign  algorithm  computes  optimal  values  for  the  design  parameters 
{Pi’P2>P3»<li-Q2»q3 }  simultaneously  computes  a  control  gain  which  minimizes  a 
quadratic  cost  function,  subject  to  the  constraint  that  the  closed-loop  system  matrix  is 
preserved  and  the  redesigned  stiffness  matrix  is  bounded  by 

^<trace[:7C+A!^<^. 

This  last  constraint  is  imposed  to  place  a  lower  bound  on  the  stiffness  matrix  of  the 
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redesigned  member.  The  redesigned  FEM  dynamics  are  represented  by  the  following: 


(fAf  +  A!Af)u(t)  +  {aM  +  p!?C+  oAM  +  PA:?Ou(t)  +  {%+  A!^u(t)  = 
AiW  =  !Pi5pi  +  ?p25p2  +  ^P38p3 


QrSqi  +  Q25q2  +  Q35q3 


^c(t)  =  G 


u(t) 

u(t) 


The  matrix  G  in  (1)  is  determined  to  solve  the  OVC  control  problem.  Then,  the 
parameters  5pi,  5p2,  i  =  1,2,3,  and  G  are  determined  to  match  the  closed  loop  system 
matrix  (all  eigenvalues,  eigenvectors),  by  a  quadratic  programming  algorithm,  with 
guaranteed  stability  and  convergence  to  a  global  optimum.  See  Appendices  B,  C  and  D. 


Numerical  Results 

The  finite  element  model  of  the  truss  member  prior  to  member  redesign  is 
characterized  by  its  mass,  stiffness,  and  damping  matrices: 


'l.6264e-03  5.4214e-04  0 

'l.5457e+06  -5.1522e+05  0 

lAf  = 

5.4214e-€4  1.8121e-03  1.1645e-04 
0  1.1645e-04  4.658  le-04 

-5.1522e+05  3.0737e+06  -2.5585e+06 
0  -2.5585e+06  2.5585e+06 

‘D  = 


1.5457e-01  -5.1522e-02  0 

-5.1522e-02  3.0738e-01  -2.5585e-01 
0  -2.5585e-01  2.5585e-01 


Our  redesign  algorithm  resulted  in  the  following  redesign  FEM  which  is  optimal  with 
respect  to  the  constraints  we  have  imposed: 


9/(  +  AiAf  = 

’l.4728e-03  4.9094e-04  0 

4.9094e-04  1.6410e-03  1.0545e-04 

'l.3997e+06  -4.6656e+05  0 

-4.6656e+05  2.7834e+06  -2.3169e+06 

0  1.0545e-04  4.2182e-04 

0  -2.3169e+06  2.3169e+06 

11 


(D  +AD  = 


1.3997e-01 

-4.6656e-02 

0 


-4.6656e-02 

2.7835e-01 

-2.3169e-01 


0 

-2.3169e-01 

2.3169e-01 


G  = 


34.9902,  -19.4386,  -13.4445,  -0.0533,  -0.3006,  -0.1009 


where  the  optimal  values  for  the  design  parameters  are  given  in  Table  3.  For  this 
example  we  took 


5.4  X  10^  Ib/in  <  trace[!^+  <  <»  . 


It  is  easy  to  see  that  both  the  mass  and  stiffness  matrices  have  decreased,  but  what 
is  not  obvious  is  that  the  redesign  preserved  the  modal  frequencies  and  modal  damping 
(by  the  Rayleigh  assumption)  of  the  open  loop  system,  i.e.,  the  following  was  preserved: 

Since  the  closed-loop  system  matrix  before  and  after  the  redesign  was  constrained  to  be 
the  same,  note  that  together  with  the  above  equality  the  redesign  constraints  imply  that 


Hence  we  see  that  the  redesign  preserved  the  product  of  the  control  distribution  matrix  <I) 
and  the  controller  gain,  so  that  a  decrease  in  truss  member  mass  implied  a  decrease  in 
required  control  gain,  which  is  equivalent  to  a  reduction  of  control  effort  in  the  redesign 
method. 


12 


Table  3 


Values  for  the  optimal  design  parameters 


Pi  spALi 

2.2659e-03 

P2  =  PAL2 

4.5318e-03 

P3  -  pA(L  -  Li  -  L2) 

1.2168e-03 

qi  =  EA/Li 

1.4356e+06 

q2  =  EA/L2 

7.1779e+05 

q3  =EA/(L-Li  -L2) 

2.6733e+06 

We  considered  the  case  where  the  redesigned  member  was  uniform  over  its  length.  This 
led  to  necessary  conditions  on  the  design  parameters  to  make  them  realizable  from 
physical  parameters  {p,E,A,Li,L2,L3 }  which  are  given  by: 


PiQi -P2q2 -PsQs  • 

If  these  conditions  are  met,  then  the  element  lengths  Li,  L2,  and  L3  must  sum  to  the  total 
length  of  the  truss  member,  L,  and  are  uniquely  determined.  Also,  the  design  parameters 
must  satisfy: 


E 

P 


Pi  P2  P3 


For  the  optimal  values  of  the  design  parameters  listed  in  Table  3,  it  may  be  shown  that 
the  design  freedom  is  to  choose  E  and  p  subject  to 


—  =  — Lf  =  1.4255e+ll  . 

P  Pi 

For  the  truss  member  redesign,  once  any  one  of  {p,E,A}  is  chosen  the  remaining 
quantities  are  determined  by  the  design  parameters  {pi,P2.p3,qi.q2.q3 }•  Therefore  we 
computed  p.  A,  and  E  for  two  cases:  (1)  E  equal  to  the  original  design  value  and  (2)  A 
equal  to  the  original  design  value.  Table  4  summarizes  the  truss  member  redesign.  Note 
that  the  quantity  Er-1  is  constant  before  and  after  the  redesign,  so  that  the  ratio  is 


preserved  by  the  design  method,  i.e., 


E 

P 


— (L-Li-L2)2 
P3 


is  an  invariant  in  truss  members  using  linear  elements. 


Table  4 


Physical  properties  of  the  member  redesign 


Original  Design 

E  fixed 

A  fixed 

p  (slugs/in^) 

1.3469e-03 

* 

1.2197e-03 

E  (psi) 

16.0  X  10^* 

♦ 

14.49  X  10^ 

A(in^) 

0.0805 

7.2900e-02 

* 

Li  (in) 

15.0 

15.0 

15.0 

L2(in) 

30.0 

30.0 

30.0 

L3  (in) 

8.055 

8.055 

8.055 

Tables  5a-5b  summarize  the  results  of  the  truss  member  and  controller  redesign.  Note 
that  the  redesign  preserved  the  OVC  constraints  for  given  initial  conditions 
{ui  (0),U2(0),U3(0),ui(0),U2(0),U3(0)}  as  guaranteed  by  our  theory. 


*  These  values  were  chosen  to  be  the  same  as  the  original  design. 
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Table  5a 

Output  variances  due  to  initial  conditions 


OVC  Bound 

Initial  FEM 

FEM  Redesign 

7.6304e-07 

7.6304e-07 

7.6304e-07 

4.1421e-06 

2.9139e-06 

2.9139e-06 

4.3767e-06 

3.2784e-06 

3.2784e-06 

Table  5b 

Active  control  effort  for  the  FEM 


Initial  FEM 

FEM  Redesign 

Change  (%) 

7.4913e+01 

6.1431e+01 

-18.0 

It  is  important  to  reali2K  that  in  the  most  general  design  problem  for  this  example  we 
have  at  our  disposal  eleven  design  and  model  parameters,  these  being 
{Pi>P2.P3.Ei,E2,E2,Ai,A2,A3,Li,L2},  while  this  example  used  only  five  of  the 
modeling  and  the  control  design  parameters.  The  choice  of  different  material  properties 
Pi,  Ei  will  be  utilized  in  the  modeling  of  the  piezoelectric  material  forming  the  composite 
structure  for  the  next  stage  of  development  to  integrate  structure,  actuator,  sensor,  and 
control  design.  This  will  allow  the  structures  to  truly  be  "smart". 

ni.  Conclusions  to  date 

•  A  convergent  algorithm  has  been  developed  which  generates  optimal  choices  for 
material  selection  and  control  design  for  the  Laser  Crosslink  Structure  (LCS),  or 
any  other  similar  truss  structure. 

•  Software  is  now  available  for  this  algorithm. 
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•  Preliminary  results  have  produced  an  invariant  combination  of  the  material 
properties  for  truss  elements.  We  hope  to  show  that  such  invariant  properties  will 
apply  to  designs  of  other  classes  of  systems. 

Apart  from  the  theoretical  issues  explored  in  the  example  of  section  H,  other  theoretical 
issues  which  remain  open  are 

How  to  optimally  redesign  a  vector  second  order  system  with  white  noise 
disturbances 

How  to  redesign  a  vector  second  order  system  or  linear  system  with  parameter 
dependent  control  and  output  matrices. 

How  to  formulate  mathematically  tractable  constraints  on  the  design 
parameters  {pj.qj },  which  are  directly  related  to  dynamic  and  static  loads  on  a 
structure. 

The  development  of  a  covariance  control  theory  for  vector  second  order 
systems. 
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PHILLIPS  LAB  LASER  CROSSLINK  STRUCTURE 


CONCLUSIONS: 

MONOTONIC  CONVERGENCE  (TO  WITHIN  lO'*®  ERROR)  IN  8 
ITERATIONS. 

REDESIGN  GUARANTEES  SPECIFIED  POINTING 
PERFORMANCE  BOUNDS  II  y  II  <  a  OF  LASER. 

ACTIVE  CONTROL  REDUCTION  13%. 

STRUCTURAL  MASS  REDUCTION:  8%. 

SOFTER  STRUCTURE  EASIER  TO  CONTROL! 
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APPENDIX  A 


Physical  Data  for  the  LCS  members 


OUTER  DIAMETER  (inches) 

1.050 

THICKNESS  (inches) 

0.050 

ELASTICITY  (psi) 

16.0  X  10^ 

DENSITY  (slugs/in^) 

1.3469  X  10-^ 

Coordinate  Locations  of  the  Pin  Joints 


NodelD 

X-coordinate 

Y-coordinate 

Z-coordinate 

10 

0.0000 

0.0000 

0.0000 

20 

27.2315 

19.5420 

0.0000 

30 

27.2315 

-19.5420 

0.0000 

40 

6.2625 

3.0310 

45.7960 

50 

6.2625 

-3.0310 

45.7960 

60 

15.6005 

0.0000 

44.8420 

Modal  Cost  Analysis 

The  modal  cost  analysis  of  an  LCS  finite  element  model  using  third  order  finite 
elements  to  model  the  axial  dynamics  is  given  in  Table  A.L  The  purpose  of  modal  cost 
analysis  is  to  calculate  the  contribution  of  the  i'**  modal  coordinate  to  a  quadratic  cost 
function.  For  this  analysis  we  took  as  our  output  vector,  y(t),  the  relative  translation  of 
each  node  of  the  laser  platform  to  the  remaining  platform  nodes.  The  control  actuators 
were  idealized  point-actuators  applied  at  the  center  of  each  of  the  six  structure  members 
which  attach  to  the  laser  platform.  We  assumed  that  the  intensity  of  the  impulses  applied 
to  the  control  channels  was  unity,  and  we  weighted  the  components  of  the  output  vector 
equally  by  choosing  Q  to  be  identity. 

Table  A.l  summarizes  the  results  of  the  modal  cost  analysis,  sorting  the  modes 
with  largest  contribution  to  the  modal  cost  to  the  modes  with  smallest  contribution.  Note 
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that  the  contribution  to  the  modal  cost  does  not  increase  raonotonically  with  mode 
number. 


Table  A.l 

Summary  of  a  modal  most  analysis  of  the  LCS  model 


Mode 

Mode 

Modal  Cost 

6 

1.9585e+03 

8.298  le-05 

4 

1.8844e+03 

6.0630e-05 

5 

1.9399e+03 

2.4989e-05 

1 

9.747  le+02 

1.4526e-05 

2 

1.3461e+03 

6.5163e-06 

12 

7.0234e+03 

1.3939e-06 

10 

6.7798e+03 

1.0512e-06 

11 

6.9992e+03 

4.4241e-07 

7 

4.0901e+03 

1.7389e-07 

3 

1.6946e+03 

8.8014e-08 

8 

4.5216e+03 

3.9574e-09 

9 

5.5007e+03 

3.4057e-10 

14 

r  1.7316e+05 

2.485  le- 14 

13 

1.1643e+05 

2.0676e-14 

16 

2.9294e+05 

8.3240e-16 

15 

2.7001e+05 

5.2107e-16 

17 

4.4357e+05 

4.1507e-17 

18 

5.945  le+05 

3.8897e-17 
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Abstract 

Modern  problems  which  require  severe  con¬ 
straints  on  the  dynamic  response  will  demand  a 
theory  for  system  design,  integrating  plant  design 
with  controller  design.  Successive  covariance  ap¬ 
proximation  is  proposed  for  integrating  structure 
and  control  designs. 


1.  Introduction 

This  paper  suggests  a  need  to  develop  a  theory  of 
design  for  dynamic  systems,  subject  to  a  specific 
set  of  performance  criteria.  The  objective  is  to 
integrate  the  different  steps  in  the  design  process 
of  controlled  engineering  systems.  In  the  class 
of  problems  to  be  treated,  the  system  is  subject 
to  uncertain  but  bounded  errors  in  modeling,  to 
uncertain  but  bounded  disturbances,  and  we  as¬ 
sume  freedom  in  the  choice  of  some  parameters 
that  characterize  the  properties  of  each  compo¬ 
nent  of  the  total  system.  For  example,  the  design 
procedure  for  the  design  of  a  controlled  structure 
could  include:  choice  of  the  material,  choice  of 
the  sensors  and  actuators  (dynamic  range,  type, 
signal  to  noise  ratio,  location,  number)  choice  of 
the  controller  hardware/software  (controller  com¬ 
plexity,  memory,  wordlength,  quantization  strat¬ 
egy,  control  energy  required).  The  design  criteria 
includes:  bounds  on  both  the  static  response  and 
the  dynamic  response,  controller  simplicity  and 
robust  performance  (in  the  presence  of  a  specified 
set  of  parameter  uncertainties,  failures,  distur¬ 
bances),  determining  component  design  require¬ 
ments  given  system  design  requirements,  minimal 


cost  subject  to  a  performance  constraint.  Finally, 
the  design  theory  must  be  implementable  in  a 
workstation  environment  for  rapid  design  capabil¬ 
ity.  For  our  special  class  of  design  problems,  one 
could  develop  a  mathematical  theory  and  compu¬ 
tational  algorithms  which  guarantee  convergence 
to  a  feasible  solution.  This  contribution  would 
greatly  assist  or  replace  (for  this  special  class  of 
problems)  the  ad  hoc  procedures  currently  used 
in  design. 

This  talk  will  present  one  approach  called  Succes¬ 
sive  Covariance  Approximation  (SC A)  for  inte¬ 
grated  design  of  electromechanical  systems.  The 
SC  A  technique  is  an  iterative  design  of  the  electri¬ 
cal/structural  parameters  and  the  active  control 
parameters,  so  that  in  each  step  the  closed-loop 
system  performance  closely  approximates  a  pre¬ 
determined  set  of  desired  performance  objectives. 
The  design  objectives  are  expressed  in  terms  of 
the  closed- loop  state  covariance  matrix.  The  ac¬ 
tive  control  design  step  of  the  iterative  design  pro¬ 
cess  utilizes  the  newly  developed  techniques  for 
covciriance  control  design  using  alternating  pro¬ 
jections.  Covariance  control  provides  a  parame¬ 
terization  of  all  stabilizing  controllers  (hence,  the 
unifying  theme  here  is  that  any  controller  can  be 
derived  as  a  covariance  controller)  and  recent  re¬ 
search  by  the  author  has  parametrized  all  stabi¬ 
lizing  combinations  of  the  free  structural  param¬ 
eters  and  the  control  parameters.  The  structural 
design  step  solves  a  convex  optimization  with  re¬ 
spect  to  the  structural  parameters.  Each  step 
minimizes  the  distance  between  the  closed-loop 
covariance  matrix  and  the  set  of  desired  covari¬ 
ance  matrices.  The  convergence  of  this  itera¬ 
tive  structure/controller  design  method  is  guar- 
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anteed  by  the  theory  [Skelton  1989;  Wahlberg  et 
al.  1990;  Rotea  and  Prasanth  1994;  Gevers  1991; 
Skelton  1988;  Li  ec  al.  1989;  Lee  et  ai.  1994; 
Muske  and  Rawlings  1993;  Furuta  et  al.  1991]. 


2*  Motivation 

For  150  years  the  classical  theories  of  physics,  (un¬ 
derstanding  the  physical  phenomena),  the  clas¬ 
sical  theories  of  dynamic  modeling,  (developing 
mathematical  models,  such  ais  finite  elements,  for 
the  (idealized)  phenomena)  and  the  more  recent 
theories  of  control  (developing  feedback  signals 
hastd  upon  ike  model)  have  been  built  as  separate 
topics  (separated  by  boundaries  of  convenience). 
Modern  engineering  has  essentially  reached  the 
limits  of  such  thinking.  We  believe  that  the 
next  revolution  in  engineering  will  come  through 
the  systematic  destruction  of  these  disciplinary 
boundaries,  to  allow  these  (artificially  separated) 
disciplines  to  cooperate  to  achieve  performance  be^ 
yond  the  capability  of  the  isolated  approaches.  In¬ 
deed,  only  in  this  way  can  one  determine  the  u/- 
iimate  capability  of  the  engineering  mission.  Be¬ 
fore  this  can  happen,  however,  one  must  take  a 
more  fundamental  approach  to  the  design,  mod¬ 
eling  and  control  of  dynamic  systems. 

A  design  methodology  for  controlled  mechanical 
systems  should  integrate  the  following  subjects: 

1)  Plant  design:  Select  materials,  material 
properties,  and  geometry. 

2)  Sensor  and  actuator  selection:  Select  the 
number  and  location  of  sensors  and  actu¬ 
ators,  and  their  precision  (dynamic  range, 
signal  to  noise  ratios),  and  cost. 

3)  Control  design:  Develop  a  control  law  to 
guarantee  that  performance  specifications 
are  satisfied  for  the  closed-loop  system. 

4)  Controller  implementation:  De¬ 

termine  controller  precision  and  complexity 
(wordlength,  computational  time  delay)  re¬ 
quired  in  the  control  computer. 

5)  Manufacturing  tolerances:  Determine  the 
component  precision  required  to  guarantee 
a  system  performance  requirement. 

6)  Economical  designs:  Find  the  minimal  cost 
design  subject  to  a  specified  performance 
constraint,  (precision  of  components  is  re¬ 
lated  to  cost). 


We  shall  use  the  word  ‘‘design’’  in  this  proposal 
to  denote  such  a  unified  treatment  of  these  disci¬ 
plines.  A  theory  of  design  is  presently  not  avail¬ 
able.  The  ad  hoc  integration  of  disciplines  cur¬ 
rently  required  in  design  typically  requires  a  very 
experienced  engineer  to  accomplish  a  good  design. 
A  theory  of  design  would  allow  good  designs  to  be 
obtained  by  less  experienced  persons,  and  such  a 
design  theory  could  be  taught  in  universities. 

In  the  most  general  setting,  this  goal  of  develop¬ 
ing  a  mathematical  theory  of  design  is  too  ambi¬ 
tious.  Ad  hoc  iterations  will  always  be  required 
for  the  most  general  problems.  However,  by  re¬ 
stricting  the  problems  we  treat  to  a  special  class, 
one  can  expect  a  fairly  complete  solution  to  the 
design  problem. 

Finite  Signal- to- Noise  Models 

Contributions  toward  a  theory  of  design  could  be 
developed  using  a  new  class  of  models,  called  FSN 
(Finite-Signal- to- Noise)  models,  described  as  fol¬ 
lows. 

The  output  of  a  5  milliwatt  amplifier  usually  con¬ 
tains  less  noise  than  the  output  of  a  5  megawatt 
amplifier.  Even  if  the  noise  is  white,  classical  ad¬ 
ditive  models  of  noisy  signals  do  not  captme  this 
effect.  Consider  that  u(t)  is  the  signal  uncorre¬ 
lated  with  u;(t),  the  noise.  The  traditional  white 
noise  model  (for  the  continuous,  scalar  case)  is 

f  [u;(t)]  =  0  ,  £w(t)u(T)  =  0,  t  >  r 

S[wit)w{r)]  =  W6{t-T)  (1) 

where  W  is  the  constant  or  time  varying  noise 
intensity.  Let  the  variance  of  the  signal  u(f)  be 

U  =  £u^(t).  Then  the  intensity  of  the  noise  W  b 
constant  with  respect  to  the  variance  of  the  signal 
U,  Recently  we  have  developed  a  new  model  of 
linear  stochastic  processes,  using  “finite-signal-to- 
noise”  (FSN)  models  as  follows.  Assume  that  u(t) 
and  u;(t)  are  uncorrelated  as  in  (1),  but  that  the 
intensity  W  depends  linearly  on  the  variance  of 
the  signal  u(f), 

W  ^  Wo  ^(tU  .  (2) 

We  define  as  the  “signal-to-noise  ratio” 
(SNR).  We  shall  call  (1),  (2)  the  finite-signal-to- 
noise  FSN  model  of  a  noise  source.  The  standard 
noise  model  upon  which  LQG  theory  is  based  has 
an  infinite  SNR,  where  W  =  Wq.  Now  consider 
Fig.  1  where  six  FSN  sources  are  added. 
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•  u;a(0  ifl  the  actuator  noise  whose  inten¬ 

sity  W(x  is  linearly  related  to  the  variance 
of  the  iignal  part  of  u(i):  W.  =r  4- 

o’aU  =  4-  o’lG^Xc  where  for  dynamic 

controllers  Xc  is  the  covariance  of  the  con¬ 
troller  state,  and  G  is  the  controller  gain. 

•  u;p(t)  is  the  noise  whose  intensity  depends 
on  the  state  covariance:  Wp  =  Wpi  4- 
^y'pXpf  Xp  =  plant  state  covariance.  As 
an  example  of  this  type  of  noise  consider 
that  the  noise  component  of  turbulent  wind 
forces  on  a  building  is  a  function  of  the 
state  variables;  such  as  the  torsional  dis¬ 
placement  of  the  building  relative  to  the 
wind  velocity  vector.  For  larger  torsional 
angles  of  attack  the  laminar  flow  becomes 
more  turbulent,  creating  a  larger  noise  in 
the  lift  component  of  the  forces. 

•  Wg(t)  is  the  sensor  noise  whose  intensity 
is  linearly  related  to  the  variance  of  the 
measured  signal  Zp{t)  =  rnxp{t)  :  W,  = 
Wsi  -h  (T^mjXp  (sensor  SNR  =  <77^). 

•  is  the  error  in  the  input  computation 
to  the  controller.  In  a  digital  system  this 
would  be  the  roundoff  noise  in  A/D  conver¬ 
sion,  Wj  =  Wji  4-  (T^rnjXp. 

•  Wg{i)  is  the  error  in  controller  state  compu¬ 
tation. 

•  ^  noise  added  by  controller  out¬ 
put  computation,  =  W^i+alG^Xc-  In 
digital  controllers  this  would  be  roundoff  er¬ 
rors  from  D/A  conversion. 

A  design  theory  must  be  able  to  trade  component 
precision  with  closed  loop  performance.  Let  X,  G 
denote  the  state  covariance  and  control  gain  of 
the  closed  loop  system.  We  shall  cadi  any  consis¬ 
tent  matrix  pair  >  0  ,  G)  a  solution  to  the 
FSN  Covarianct  Control  problem.  The  standard 
Covariance  Control  Problem  is  defined  by  the  case 
(Ti  =  0  for  1  =  a,  c,  5,  z. 

It  may  be  shown  that  any  solution  of  the  FSN 
covariance  control  problem  has  a  guaranteed  sta¬ 
bility  margin  in  the  sense  that  all  eigenvalues  of 
the  closed  loop  system  lie  to  the  left  of  — 

The  only  extension  of  this  result  beyond  [Iwasaki 
and  Skelton,  1993;  Skelton  et  al.  1994]  is  the 
presence  of  (Tp  >  0.  If  all  cr's  are  zero,  this  is 
exactly  the  result  of  [Iwasaki  and  Skelton,  1993; 
Skelton  et  al.  1994]  which  parametrizes  all  stabi¬ 
lizing  controllers  of  order  =  rip.  It  is  possible 
with  very  little  additionail  effort  to  parametrize 


all  controllers  of  order  ri^  <  rip,  for  both  the  con¬ 
tinuous  and  discrete  case,  but  we  shall  not  state 
those  results  here.  When  all  <t^3  are  zero,  such 
results  can  be  found  in  [Skelton  et  al.  1994]. 

Alternating  projections  [Grigoriadis,  1994]  can 
be  used  to  solve  convex  problems  in  the  space 
of  symmetric  matrices  as  follows.  Consider  the 
State  Covariance  Approximation  (SCA)  problem 
of  minimizing  the  covariance  error  from  a  desired 
covariance.  For  example,  the  set  of  all  covariances 
X  such  that  CXC*  <  y  for  some  specified  C  and 
y  is  a  convex  set  that  could  describe  the  “desired 
set”  Let  the  set  of  X  satisfying  of  assignable 
X  (X  achievable  by  some  G)  be  denoted  Xp,  and 
the  set  of  X  satisfying  AT  >  0  be  denoted  by 
The  SCA  problem  can  be  stated  as 

mn  I  iX-ATd  Hz- 

subject  to  X  £  Xi  n  Xp  r\  Xfi.  Then  the  compu¬ 
tational  problem  is  to  find  Xp  £  XpHX^n  Xpj. 
The  controller  is  given  in  terms  of  X.  The  al¬ 
ternating  projection  algorithm  [Grigoriadis,  1994] 
guarantees  to  find  the  intersection  of  convex  sets. 
If  no  such  X  exists  the  same  algorithm  finds 
X  €  XpHXpd  that  minimizes  \\Xp-Xd\\F-  Other 
approaches  to  convex  control  problems  are  de¬ 
scribed  in  [Iwasaki  and  Skelton,  1993;  Skelton  et 
al.,  1994;  Grigoriadis,  1994;  Boyd  et  al.,  1994; 
Geromel  et  al.,  1993,  Grigoriadis  and  Skelton, 
1994b].  Analytical  properties  (performance,  con¬ 
trol  design  and  robustness)  of  the  FSN  Covariance 
Control  problem  should  be  studied. 

Sensor/ Actuator  Selection 

Most  control  texts  begin  with  the  assumption 
that  sensors  and  actuators  are  selected  before 
control  design.  Actually,  the  problems  of  mod¬ 
eling,  selecting  what  variables  to  measure,  se¬ 
lecting  what  variables  to  control,  and  select¬ 
ing  a  controller  are  all  interdependent  problems, 
with  no  available  scientific  procedure  to  integrate 
them.  Selecting  better  models  and  selecting  bet¬ 
ter  sensor/ actuator  variables  can  sometimes  yield 
a  more  drastic  improvement  in  robustness  and 
performance  than  simply  using  robust  control 
theory  on  the  original  model.  (This  is  not  a  state¬ 
ment  against  robust  control  but  one  to  encourage 
more  effort  on  modeling). 

It  is  well  known  that  performance  might  be  im¬ 
proved  by  deleting  a  noisy  actuator  because  the 
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noise  has  a  direct  path  to  the  output,  and  hence 
the  controller  can  never  make  the  noisy  contribu¬ 
tion  zero.  The  contribution  of  a  sensor  noise  to 
the  plant  response  can  be  made  zero  by  zeroing 
this  sensor  gain  (in  the  controller)).  Note  that 
the  act  of  deleting  the  actuator  cannot  be  accom¬ 
plished  by  the  LQG  theory  since  the  controller 
design  cannot  delete  the  noise  source,  it  can  only 
increase  the  control  signal  to  try  to  reduce  the  rel¬ 
ative  effect  of  the  actuator  noise,  (The  Kalman 
filter  gain  is  related  to  the  ratio  of  plant  (actua¬ 
tor  in  this  case)  noise  to  sensor  noise,  so  an  in¬ 
crease  in  actuator  noise  will  increase  the  Kalman 
gain.  The  control  gain  remains  constant  since 
it  is  not  a  function  of  the  noise).  Hence,  LQG 
theory  increases  the  controller  gain  when  an  ac¬ 
tuator  noise  increases.  This  might  be  exactly  the 
wrong  thing  to  do  from  an  engineering  point  of 
view!  Performance  might  be  improved  by  deleU 
ing  the  actuator,  rather  than  increasing  its  con¬ 
trol  gain  [Norris  and  Skelton,  1989;  Chen  and  Se¬ 
infeld,  1975;  Ichikawa  and  Ryan,  1979;  Goh  and 
Caughey,  1985;  Grigoriadis  and  Skelton,  1994a]. 

Suppose  the  model  of  the  plant  and  noise  sources 
are  accurate.  Let  the  admissible  set  of  actuators 
be  an  arbitrarily  large  number  of  actuators.  The 
following  is  am  open  problem. 

•  How  many  (noisy)  actuators  yield  the  best 
closed  loop  performance  (maximad  accu¬ 
racy)? 

In  the  case  of  sensors  the  answer  is  known  to  be 
the  entire  admissible  set  because  the  Kalman  fil¬ 
ter  can  set  the  gain  to  zero  if  the  sensor  is  too 
noisy.  However  in  the  case  of  actuators  the  an¬ 
swer  is  not  the  entire  admissible  set.  There  is  am 
optimal  number  of  actuators  for  the  control  of  lin¬ 
ear  stochastic  processes,  but  no  available  theory 
reveab  how  many.  (This  number  is  not  necessar¬ 
ily  the  minimal  number  required  for  controllabil¬ 
ity). 

The  conclusion  of  this  section  is  that  a  theory 
is  needed  to  suggest  which  actuators  are  helping 
and  which  are  degrading  performance.  We  call 
this  the  sensor/ actuator  selection  problem. 

A  theory  is  also  needed  to  determine  the  preci¬ 
sion  required  (e.g.  noise  allowed)  of  each  com¬ 
ponent  (sensor,  actuator,  A/D  and  D/A  con¬ 
verters)  of  the  system  to  satisfy  a  given  perfor¬ 
mance  constraint.  The  determination  of  compo¬ 


nent  design  specifications,  given  a  system  perfor¬ 
mance  specification  is  an  important  open  prob¬ 
lem.  That  is,  given  a  system  performance  con¬ 
straint  CXC*  <  Y,  determine  the  required  pre¬ 
cision  (o*”^)  of  eaudx  component  of  the  system. 

Integrated  Plant  and  Controller  Design 

The  set  of  signal-to-noise  ratios  of  the  previ¬ 
ous  section  is  only  one  set  of  system  parameters 
that  may  be  optimized.  In  some  cases,  (early  in 
the  design  phase  of  a  project)  the  plant  itself  may 
be  redesigned  for  improved  performance  [Grigori¬ 
adis  and  Skelton,  1994a].  For  the  structural  sys¬ 
tems  in  our  mechanical  system  focus  let  p  be  a 
vector  of  free  parameters  in  the  structure  design 

A<(p)q  +  I>(p)q  +  X:(p)q  =  B(p)(u  +  w) 

y  =  “Pq  +  Pq 
z  =  MpX  +  V  ,  x*  =  [q*  q*] 

where  the  parameters  appear  multilinearly 

^(P)  =  ^PiMi 

i 

i>ip)  = 

^(P)  =  ■ 

% 

A  convergent  algorithm  for  integrating  plant  and 
controller  design  is  proposed  as  follows, 

1.  For  a  given  p  solve  the  standard  covari¬ 
ance  control  problem  (e.g.  by  Alternating 
Projections),  see  [Grigoriadis  and  Skelton, 
1994b],  to  get  G. 

2.  For  the  given  controller  G  solve  the  convex 
problem 

min|lX-X,,|| 

pi 

Repeat  for  *  =  1,2,-  — 

3.  Return  to  1  until  convergence. 

Convergence  of  this  aJgorithm  to  the  global  opti¬ 
mal  solution  is  not  guairanteed.  In  a  recent  ap¬ 
plication  of  this  algorithm  a  vibration  isolation 
problem  (a  space-based  laser  on  a  support  plat¬ 
form)  is  solved  by  reducing  the  control  energy  by 
32%  and  the  structural  mass  by  22%  compared  to 
the  original  design  by  the  manufacturer  [Grigori¬ 
adis  and  Skelton,  1994a].  This  involved  selection 
of  the  cross-sectional  areas  of  the  composite  struc¬ 
tural  members,  and  the  control  gains,  to  keep  the 
L2  output  response  feasible. 
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3.  Conclusions 

We  believe  that  the  next  era  in  controls  will 
be  to  extend  the  methods  to  include  plant  de¬ 
sign,  jointly  with  control  design.  This  paper  sug¬ 
gests  that  convergent  algorithms  should  be  sought 
for  solving  or  approximating  the  FSN  Covari¬ 
ance  Control  Problem,  and  the  Economical  De¬ 
sign  Problem.  Some  progress  in  this  direction 
would  allow  component  design  from  a  given  sys¬ 
tem  performance  requirement. 
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Abstract 


Tliia  paper  considers  the  optimal  control  problem  of  minimmng  control  effort  sub¬ 
ject  t<^multiple  ^rformance  constraints  on  ontpnt  covariance  matrices  Y,  of  the  form 
Yi  <  Yi,  where  K,  is  given.  The  contributions  of  this  paper  are  a  set  of  conditions 
that  char^terize  glob^  optimality,  and  an  iterative  algorithm  for  finding  a  solntion 
to  the  optimality  conditions.  This  iterative  algorithm  is  completely  described  up  to  a 
user  specified  parameter.  We  show  that,  under  suitable  assumptions  on  problem  data, 
the  iterative  algorithm  converges  to  a  solution  of  the  optimality  conditions  provided 

this  parameter  is  properly  chosen.  Both,  discrete  and  continuous  time  problems  are 
considered. 


1  Introduction 


Consider  the  following  linear  time-invariant  system 


®p(0  “  "i"  ■^p^(0  'I'  -^p^pCO 

yp(0  =  CpXf,{t)  (1.1) 

2{t)  =  MpXp{t)+v(t) 


where  Xp  is  the  state,  u  the  control,  Wp  represents  process  noise,  and  v  is  the  measurement 
noise.  The  vector  contains  all  variables  whose  dynamic  responses  axe  of  interest.  The 
vector  z  is  a  vector  of  noisy  measurements. 

Suppose  that,  to  the  plant  (1.1)  we  apply  a  full  state  feedback  stabilizing  control  law  of 
the  form 

u(t)  =  Gxp(t) ,  '  (1.2) 

or  a  strictly  proper  output  feedback  stabilizing  control  law  given  by 


x,(0  =  A,x,(f)  +  /’z(f) 
u(t)  =  Gxcit) . 


(1.3) 


Then,  the  resulting  closed  loop  system  is 


x{t) 

y{i) 


Ax{t)  -I-  Dw' 

yp(0  ]  ^ 
u(t) 


(0 

'C-v 


x{t)  =  Cx{t)  , 


(1.4) 


where  for  the  state  feedback  case  we  have  x  —  Xp  and  w  =  Wp,  while  for  the  output  feedback 
case  we  have  x  =  [xj  and  w  =  [wj  .  Moreover,  formulae  for  A,  C,  and  D  axe  easy 
to  obtain  from  (1.1),  and  (1.2)  or  (1.3). 

Consider  the  closed  loop  system  (1.4).  Let  Wp  and  V  denote  positive  definite  sym¬ 
metric  matrices  with  dimensions  equal  to  the  process  noise  Wp  and  measurement  vector  r, 
respectively.  Define  W  =  Wp,  if  the  state  feedback  controller  (1.2)  is  used  in  (1.4),  or 
^  ~  block  diag[Wp,  V]  if  (1.3)  is  used  in  (1.4).  Let  X  denote  the  closed  loop  controllability 
gramian  from  the  (weighted)  disturbance  input  Since  A  is  stable,  X  satisfies 


0  =  AX  +  XA^  +  DWD^  . 


(1.5) 
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P^ition  the  performance  output  in  (1.4),  into  y,  :=  [yf.yf, . . . ,  yTjT  y.  ^  ^ 

7V^  for  »  =  1,2, . . . ,  m.  In  this  paper  we  are  interested  in  finding  controUers  of  the  form 
(1.2)  or  (1.3)  that  minimize  the  (weighted)  control  energy  trace  RC^XCj  with  iJ  >  0  and 
satisfy  the  constraints  ’ 

yi  =  CiXCf  <Y, ,  i  -  1,2,.. .,m,  (15^ 

where  F.-  >  0  (i  =  1, 2, . . .  ,m)  are  given  and  X  solves  (1.5).  This  problem,  that  we  call  the 
the  Output  Covariance  Constraint  (OCC)  problem,  is  defined  as  foUows: 

The  QCC  Problem 

Find  a  static  state  feedback  or  full  order  dynamic  output  feedback  controller  for  system  (1.1) 
to  minimize  the  OCC  cost  ^  * 


Jocc  =  trace  RCuXC^  ;  R>0 

subject  to  (1.5)  and  (1.6).  □ 


The  OCC  problem  may  be  given  several  interesting  interpretations.  For  instance,  assume 
first  that  Wp  and  v  are  uncorrelated  zero  mean  white  noises  with  intensity  matrices  Wp  >  0 
3Jid  V  >  0.  That  is,  let  £  be  an  expectation  operator,  and 

^K(i)]  =  0  ;  £[wpit)wj{t  -  r)]  =  Wp5{r)  , 

£[v(t)]  =  0  ;  £[v(t)v^(t  -  t)]  =  l/^(r)  . 

Letting  :=  and  W  =  Wp  for  the  case  of  state  feedback,  or  W  =  block  diag 

\Wp,  V]  for  the  output  feedback  case,  it  is  easy  to  see  that  the  OCC  is  the  problem  of 
minimizing  Soo'u^R'u  subject  to  the  output  covariance  constraints  Y,  :=  £<3oyi{t)yJ {i)  <  F,-. 
As  is  weU  known,  these  constraints  may  be  interpreted  as  constraints  on  the  variance  of  the 
performance  variables  or  lower  bounds  on  the  residence  time  (in  a  given  ball  around  the 
origin  of  the  output  space)  of  the  performance  variables  [10]. 

The  OCC  problem  may  also  be  interpreted  from  a  deterministic  point  of  view.  To  see 
this,  define  the  Coo  and  C^  norms 


II  y.IlL  •=  supt>0  yT{i)yi{t) 
II  »"ll2  ==  JT  'ji^{t)w{t)dt , 


and  define  the  (weighted)  C2  disturbance  set 


(1.9) 


W  :=  {u;  :  i?  ->  RT-and  1|  <  1},  (1.10) 

where  >  0  is  a  real  symmetric  matrix.  Then,  for  any  u;  €  W,  we  have  [17,  18] 

II  y-IlL  <  ^[F]  :  »  =  1, 2, . . . ,  m,  (1.11) 

and 

ilt^.IlL  <  [CuXCl]ii  ;  i  =  l,2,...,n„,  (1.12) 

where  n„  is  the  dimension  of  u.  (Here,  o^]-]  denotes  the  maximum  singuleir  value  and  [  ],-,•  is 
the  :-th  diagonal  entry).  Moreover,  references  [17,  18]  show  that  the  bounds  in  (1.11)  and 
(1.12)  are  the  least  upper  bounds  that  hold  for  an  arbitrary  signal  w  6  W. 
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T^U3,  if  we  denne  Y,  ;=  /„,c,  in  (1.6)  and  R  :=  dxa^  [n,  rj, . . . ,  r^J  b  (1.7)^  the  OCC 
problem  is  the  problem  of  minimizing  the  (weighted)  sum  of  worst-case  peak  values  on  the 
control  signals  given  by 

Jocc  =  i;r,{sup  Ilu,||^}  (1.13) 

,=  l  *»€W  ^  > 

subject  to  constraints  on  the  worst-case  peak  values  of  the  performance  variables  of  the  form 

sup  |Iy.i|«  <  £?  ,  i  =  (1.14) 

This  interpretation  is  important  in  applications  where  hard  constraints  on  responses  or  ac¬ 
tuator  signals  cannot  be  ignored;  such  as  space  telescope  pointing  or  machine  tool  control. 

Control  problems  related  to  the  OCC  problem  defined  here  have  been  considered  before 
by  several  authors.  See,  for  example,  [6,  9,  5,  1,3,  15,  16]  for  work  in  multiobjective  optimal 
control  with  quadratic  cost  functionals,  [13,  14,  4,  19]  for  the  so-called  variance  constraint 
control  problems,  and  [12]  for  the  so-called  generalized  control  problem. 

In  the  above  references,  one  may  find  two  different  approaches  for  solving  this  class  of 
optimal  control  problems.  The  approach  based  on  solving  the  optimality  conditions  cor¬ 
responding  to  the  optimization  problem  at  hand  [4,  16,  19],  and  the  approach  based  on 
reducing  the  given  problem  to  a  finite  dimensional  convex  optimization  problem  [1,  3,  12]. 

In  this  paper,  we  follow  the  approach  initiated  in  [4,  19].  Here,  we  consider  a  more 
general  and  realistic  problem,  i.e.  the  OCC  problem,  than  the  one  studied  in  [4,  16,  19], 
and  provide  an  iterative  algorithm  for  solving  the  optimality  conditions  corresponding  to 
this  problem.  Our  main  contribution  is  in  the  algorithm  itself.  This  iterative  algorithm  is 
completely  described  up  to  a  user  specified  parameter.  We  show  that  the  algorithm  converges 
to  a  solution  of  the  optimality  conditions  (assuming  one  exists)  provided  the  user  specified 
parameter  is  properly  chosen.  Both,  discrete  and  continuous  time  problems  are  considered. 

The  paper  is  orgamized  as  follows.  Section  2  provides  optimality  conditions  for  the 
continuous-time  OCC  problem  in  the  case  of  state  feedback.  These  conditions  comprise 
one  algebraic  Riccati  equation  and  one  Lyapunov  equation.  The  Riccati  equation  has  a 
forcing  term  depending  on  a  matrix  Q  (which  represents  the  Kuhn-Tucker  multipliers)  that 
must  be  determined.  An  algorithm  for  finding  this  matrix  Q  is  given,  and  its  convergence 
analyzed.  Section  2  concludes  with  the  extension  of  the  state  feedback  residts  to  the  output 
feedback  case.  Section  3  is  the  discrete-time  version  of  Section  2.  An  example  is  presented 
in  Section  4  to  illustrate  the  performance  of  the  algorithm.  Section  5  gives  the  conclusions 
of  this  work. 

The  notation  used  in  this  paper  is  fairly  standard.  Given  the  continuous-time  algebraic 
Riccati  equation 

0  =  Ajir  +  KA^  -  KB^R-^BjK  -H  C^QC^  , 

we  say  that  K  is  the  stabilizing  solution  if  K  =  satisfies  the  Riccati  equation  and 
Ap  —  BpR~^BjK  has  all  eigenvalues  in  the  open  left  haJf  plane.  Similarly,  given  the  discrete- 
time  algebraic  Riccati  equation 

K  =  A'^KAp  -  AjKBpiR  -f  B^KBjy^BjKAp  +  CjQCp , 
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we  say  that  K  is  the  stabilizing  solution  ]£  K  =:  satisfies  the  Riccati  equation  and 

+  Bj,K Bj)~^  Bj K Af  has  all  eigenvalues  in  the  open  unit  disk.  Note  that  when 
the  (discrete  or  continuous)  stabilizing  solution  exists  it  is  unique.  Moreover,  if  Q  =  >  0 

the  stabilizing  solution  is  positive  semidefinite.  ” 

2  The  OCC  Algorithm  for  Continuous  Systems 
2.1  The  OCC  Algorithm  for  State  Feedback 

In  this  section  we  consider  the  case  of  state  feedback.  With  the  state  feedback  controller 


(1.2)  the  closed  loop  system  matrices  in  (1.4)  are  given  by 

+  BpG  ;  D  =  Dp  •,  Cy  =  Cp]  (7*  =  G  .  (2.1) 

The  following  theorem  provides  conditions  for  optimality  in  the  state  feedback  case. 
Theorem  2.1  Suppose  thtrt  exists  a  matrix 

Q-  =  block  diag[Q'^,  Q],. . .  ,Q-J  >  0  ;  Q:  =  Qf  €  iT**"**  ;  i  =  1, 2, . . . ,  m.  (2.2) 
such  that  the  algebraic  Riccati  equation 

Q  =  J^KA-KAp-  KBpBT^BjK  +  CjQ’Cp  (2.3) 

has  the  (unique)  stabilizing  solution  A"’.  Define 

cr  =  -ir'BjK- ,  (2.4) 

and  let  X*  denote  the  unique  solution  of  the  Lyapunov  equation 

0  =  (>lp  +  BpG’)X  +  X[Ap  +  BpCrf  +  DpWpD^  ,  (2.5) 

and  define  Yi  =  CiX’Cj  (i  =  1, 2, . . . ,  mj.  Then,  if 

fl  =  {Yi-Yi)Q:andYi<Yi  (2.6) 


for  all  i  —  1,2,  ...,m,  we  have  that  G"  given  by  (2.4)  is  an  optimal  solution  to  the  OCC 
problem  defined  in  (1.7). 


Proof;  Let  Q"  be  given  by  (2.2)  and  define  the  following  LQ  problem. 

mm  J (G,  X)  =  trace  RGXG'^  +  £  trace  {CiXCl  -  Yi)Q-  (2.7) 
subject  to  Ap  +  BpG  stable  and 

0  =  (X,  +  B,G)X  +  XiA,  +  B,Gf  +  D,W,Dj  .  (2.8) 
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Using  a  simple  completion  of  square  argument,  it  is  easy  to  see,  from  (2.3),  (2.4)  and  (2  S'! 
that  (G-,A’*)  solves  (2.7).  v  /  v  ;  k  ■  ), 

Now  let  G  denote  a  feasible  controUe^( arbitrary  but  fixed)  for  the  OCC  problem.  That 
is,  (Ap  +  BpG)  is  stable  and  CiXCj  <  Yi  (for  all  t  =  1,2, ...,m),  where  X  is  the  closed 
loop  gramian  corresponding  to  G.  From  the  previous  paragraph,  we  get  that 

JocciG',X')  =  trace  RG'X"{G'f +  J2Ziiraai{CiX'C^ -Yi)Q- 

<  trace  RGX(^  +  trace  {CiXCr  -Yi)Q:  ‘  (2.9) 

<  trace  RGXO^  . 

Using  the  fact  that  0  =  {C,X'Cj  -  F,)g;,  from  (2.9),  we  obtain 

trace  RG“ X' {O’ Y  <  trace  RGXG^  .  (2.10) 

This  last  inequality  ^gether  with  the  fact  that  G*  is  also  feasible  for  the  OCC  problem, 
because  CiX'Cj  <  Yi  (for  all  i  =  1,2, ...,m),  imply  that  G*  is  a  solution  to  the  OCC 
problem.  □ 


From  (2.3)  and  (2.4),  it  follows  that  the  solution  of  the  OCC  problem  with  static  state 
feedback  is  an  LQ  controller  with  a  special  choice  of  output  weighting  matrix  Q.  Therefore, 
our  algorithm  for  solving  the  conditions  in  Theorem  2.1  only  needs  to  iterate  on  Q. 

Before  giving  the  algorithm  we  would  like  to  mention  that  the  existence  of  Q’  satisfying 
the  conditions  of  Theorem  2.1  is  necessary  in  certain  cases.  For  example,  from  Theorem  5.8 
of  [5],  it  follows  that,  when  the  constraints  in  (1.6)  are  scalar,  and  (for  example)  the  pairs 
{Ci,Ap),  . . . ,  {Cm,  Ap)  do  not  have  imaginary  axis  unobservable  modes,  then  a  diagonal  Q* 
exists  if  a  solution  to  the  OCC  problem  exists.  See  also  reference  [3].  The  case  of  block 
diagonal  matrices  Q  does  not  seem  to  appear  in  the  published  literature.  It  should  be 
noted  that  the  emphasis  of  the  present  paper  is  an  algorithm  for  computing  Q’  (and  thus  a 
controller  that  solves  the  OCC  problem)  under  the  assumption  that  a  matrix  Q*  satisfying 
the  conditions  of  Theorem  2.1  exists.  This  algorithm  is  given  next. 

To  give  this  algorithm  we  need  to  introduce  the  following  operator.  Let  M  denote  a  real 
symmetric  matrix  and  suppose  that 

M  =  [Ui  U2]  block  diag  [Ep,  En]  [U^  (2.11) 

is  the  (real)  Schxir  decomposition  of  M,  where  Ep  and  En  are  diagonal  matrices  containing 
the  strictly  positive  and  nonpositive  eigenvalues  of  M,  in  decreasing  order,  respectively;  and 
[Ui  U2]  is  an  orthogonal  matrix.  Define 


V\M]  =  (  ^  ;  if  M  <0 

^  U\EpUj  ;  otherwise . 


(2.12) 


Note  that  if  A/  is  a  symmetric  matrix  with  block  diagonal  structure,  the  operator  'P[-] 
preserves  the  block  structure,  i.e.,  V[M]  has  the  block  structure  of  A/. 

The  following  algorithm  for  solving  the  conditions  in  Theorem  2.1  is  the  main  contribution 
of  this  paper. 


The  OCC  Algorithm 
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1)  Given  Bp,  Dp,  Cp,  Wp,  R,Y^  =  block  diag^ i.Fj, . .  .,Ym],  an  initial  point  ^(0)  = 

block  diag  [Qi(0),  (52(0), . . . ,  g„(0)]  >  0,  and  constanta  a  >  0,  0  <  .5  <  1,  let  ;  =  0 
and  go  to  2). 

2)  Compute  K{j)  >  0  and  G{j)  by  solving 

GO)  :  +  + 

3)  Compute  X(j’)  by  solving 

0  =  [-4,  +  B,GU)\X{])  +  X{j)[A,  +  fl,G0)l"'  +  D,W,DJ.  (2.14) 

4)  Set  K(i)  =  CiX{j)CJ  for  i  =  1, 2, . . .  ,m. 

5)  Let  y*(j)  =  block  diag  [JKflO)),  n((3(;)), ....  K„(<?(;))],  and 

Qii  +  1)  =  WO)  +  (1  -  mQU)  +  ‘>{^*0)  -  F*}|  .  (2.13) 

j  = ;  + 1,  go  to  2),  □ 

Several  stopping  criteria  may  be  used  to  guarantee  that  the  OCC  algorithm  terminates  in 
a  finite  number  of  steps.  In  this  paper,  we  propose  to  stop  the  aJgorithm  whenever  the  first 
equation  in  condition  (2.6)  is  satisfied  to  a  given  numerical  accuracy.  This  can  be  achieved 
by  checking  if  the  inequality 


E  11(3^0) -K,)<5,(j)i|<r  (2.16) 

1=1 

holds,  where  e  >  0  is  the  specified  tolerance.  Inequality  (2.16)  must  be  tested  after  step  4). 
If  (2.16)  holds,  we  stop  the  algorithm,  and  declare  G{j),  QiU),  QiU),  and  Qmij)  to  be  a 
numerical  solution  to  the  OCC  problem;  if  (2.16)  does  not  hold,  the  algorithm  continues. 
The  rest  of  this  section  is  devoted  to  show  that,  imder  the  assumption 

(Al)  {Ap,  Bp)  is  stabilizable  and  Ap  has  no  eigenvaJues  on  the  imaginary  cLxis, 

if  there  exists  Q’  satisfying  the  conditions  in  Theorem  2.1  then  the  OCC  algorithm  will  find 
it,  provided  a  is  properly  chosen.  More  specifically,  under  the  assumptions  mentioned,  we 
wiU  show  that  the  sequence  of  matrices  {Q(j)}^  generated  by  the  OCC  algorithm  (see 

equation  (2.15))  has  a  limit  Q  which  satisfies  all  the  conditions  of  Theorem  2.1.  Thus,  the 
OCC  algorithm  converges^ to  a  globally  optimcJ  solution  to  the  OCC  problem.  Note  that 
the  existence  of  the  limit  Q  implies  that,  given  any  e  >  0,  there  exists  an  integer  j  such  that 
inequality  (2.16)  holds. 

Note  that  the  OCC  algorithm  is  well-posed  in  the  sense  that  the  unique  positive  semidef- 
inite  solution  K{j)  to  the  Riccati  equation  (2.13)  and  the  solution  X{j)  to  the  Lyapunov 
equation  (2.14)  exist  at  each  iteration.  This  follows  from  assumption  (Al)  and  the  fact  that, 
at  each  iteration,  Q{j)  >  0.  As  is  well  known  [7],  since  (Ap,Bp)  is  stabilizable  and  the  pair 
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Jiaa  no  imaginaxy  axis  unobservable  modes,  K{j)  >  0  exists,  it  is  unique, 
and  it  renders  —  BpR~^BjK{j)  asymptotically  stable. 

To  establish  our  results  we  need  to  introduce  the  following  operators 

Wl  :=  ^Q  +  {1-0)T[Q]-, 

W]  :=  +  n{r*((5)  -  F*}] , 

where  a  >  0  and  0  6  (0, 1)  are  parameters  of  the  OCC  algorithm.  Note  that,  with  this 
notation,  the  sequence  of  matrices  Q(j)  generated  by  the  OCC  aJeorithm  is 
where  ^(0)  >  0  is  block  diagonal.  ^  ^  ^ 

Theorem  2.2  Consider  the  OCC  algorithm  and  suppose  that  a  >  0,  0  <  B  <  1  and 
that  assumption  (Al)  holds.  Suppose  that  the  algorithm  converges,  that  is,  the  sequence 
converges  to  Q\  Then  Q’  :=  block  diag  satisfies  the  suf¬ 

ficient  conditions  in  Theorem  2.1  for  optimality.  In  other  words,  if  the  OCC  algorithm 
converges,  the  resulting  controller  u=-jRr^Bf K'x,  where  K*  solves  (2.3),  is  a  global  op¬ 
timal  solution  to  the  given  OCC  problem,  where  Q"  is  the  limit  of  the  convergent  sequence 
{^'W(0)!}”o. 

The  proof  of  Theorem  2.2  requires  the  following  lemma. 

Lemma  2.1  For  any  symmetric  matrices  M  —  and  N  —  of  the  same  dimensions, 
the  following  statements  hold: 

1. 'P[M  +  N]  =  MifandonlyifM>0,N<QandMN  =  Q. 

2.  WVlM]  —  'P[iV]|l  <  11  Af  —  iV||,  where  ||  •  ||  denotes  the  Frohenius  norm. 

Proof:  First,  we  shall  show  the  necessity  part  of  1.  The  property  A/  >  0  is  a  direct 
consequence  of  the  definition  of  P[-]  in  (2.12).  Next,  we  show  that  iV  <  0  and  MN  =  0.  Let 
M  N  have  the  Schur  decomposition 

M  +  N  [U^U2]blockdiag[E^,Er][U,U2V 

=  UiE^U^-hUaE^^Uj,  ^2.18) 

where  E^  >  0  and  E,,  <  0.  Thus,  from  (2.12)  and  V[M  +  N]  =  M  vfe  obtain 

V[M  +  N\  =  UiEj,U'(  =  M  .  (2.19) 

Subtracting  this  last  equation  from  (2.18)  we  obtain 

N  =  U2EnUj  <  0.  (2.20) 

Since  =  0,  from  (2.19)  and  (2.20)  it  foUows  that 

MN  =  L\  EpUj  U^En  Uj  =  0. 

Second,  we  shall  show  the  sufficiency'  part  of  1.  Let  M  ^  0  and  N  ^  0  be  given  and 
suppose  that  A/iV  =  0.  Note  that  if  either  A/  or  iV  is  zero,  the  sufficiency  of  property  1)  is 
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trivial.  Now  suppose  that  M  and  iV  ^  0.  The  real  Schur  decompositions  of  M  and  N 
are 

M  =  UxE,Uj  ;  N=U2E„UJ, 

where  Ej,  >  Q,  En  <  0,  UjU^  =  I,  UjU^  =  /  and  C/ff/j  =  0.  Then, 

V[M  +  N]  =  V[U^E,Uj  +  U^E^U^]  =  =  M  .  (2.21) 

Finally,  we  show  property  2).  Let  M  and  N  have  the  following  Schur  decompositions: 

M  =  [U,  Ui]block  diag[E,  ,  En][Ui  ;  E,>0-  E^<0- 

N  =  [U^  U^\hlock  diag[Ef  ,  Fn][l/:  U-iV  ;  >  0  ;  £"«  <  0.  (2.22) 

Let 


A/+  :=  V[M\  =  U^E^Uj 
M-  :=  U:iE^U^  <  0, 
iV+  :=  V[N]  =  U^Ej,U^  >  0, 

N-  :=  U-iEnlJ^  <Q. 

Note  that  M  =  M^  +  M~ ,  N  =  iV+  +  iV",  =  0,  and  iV+iV"  =  0.  Then, 

l|A/-iV||2  =  ||(A/+-iV+)  +  (M- -iV-)||2 

=  |liV/+-iV+f +  ||Af--iV-f  (2.23) 

—2tra^M'‘  —  2iractM'^  N~ 

Since  -traceM~N’^  >  0  and  -traceM'^N~  >  0,  we  obtain 

\\M  -  Nil’  >  11M+  -  N+ll’  =  \\V[M]  -  7?[N]||’ ,  (2.24) 

which  completes  the  proof.  □ 

The  following  lemma,  essentially  due  to  [2],  is  also  required  for  the  proof  Theorem  2.2. 

Lemma  2.2  Consider  the  plant  defined  in  (1.1)  and  suppose  that  assumption  (Al)  holds. 
Let  K  denote  the  unique  stabilizing  solution  to  the  Riccati  equation  (2.3)  with  Q  =  >  0. 

Then  K{Q)  is  a  real  analytic  function  of  Q  =  >  0. 

Proof  of  Theorem  2.2:  By  Lemma  2.2,  the  state  feedback  control  gain  G{Q)  in  (2.4)  is 
a  continuous  function  of  >  0.  Hence,  the  block  output  covariance  matrix  y'^(Q)  is 

continuous  with  respect  to  Q  =  >  0.  Since  the  operator  P[-]  is  continuous,  we  obtain 

that  T[’]  and  Tp^]  are  well  defined  and  continuous  for  any  Q  —  >  0.  Suppose  that 

{T^[Q[^)\}%q  converges  to  Q%  i.e., 

VlQi^)]  =  Q’-  (2.25) 

Since  fi  €  (0, 1)  and  V[-\  preserves  the  block  structure,  we  may  conclude  that,  for  each  j, 
Tg  [^(0)]  has  the  correct  block  diagonal  structure  and  it  is  positive  semidefinite.  Thus,  Q'  = 
block  diag  [Qj, Ql,...,  Q'„]  and  Q'  >  0. 
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(2.26) 


From  the  continuity  properties  of  7^,  we  obtain 

T3[Q-\^Ta{\im  Ti’[(3(0)|)  =  Jim  =  Q*. 

That  is,  (J*  is  a  fixed  point  of  7^(’].  Since  ^  1,  from  (2.17),  we  get 

Q-  =  TIQ-J  =  +  c,{y‘((}-)  -  F*}]  .  (2.27) 

Let  M  =  Q'  and  jV  =  a[y*(Q*)  —  F*].  From  Lemma  2.1,  we  conclude  that 

Q[y‘(g*)  -  F*]  <  0  and  aQ‘[Y\Q-)  -  F*]  =  0  . 

Since  a  >  0,  the  above  inequalities  imply  that  Q‘  satisfies  (2.6).  Hence,  Q‘  satisfies  the 
conditions  in  Theorem  2.1.  This  completes  the  proof.  □ 

The  following  result  shows  that  there  is  always  a  choice  for  the  parameter  a  in  the  OCC 
algorithm  that  will  guarantee  its  convergence,  provided  the  conditions  in  Theorem  2.1  admit 
one  solution. 

Theorem  2.3  Suppose  that  assumption  (Al)  holds.  Assume  also  that  there  exists  Q“  sat¬ 
isfying  the  conditions  in  Theorem  2.1.  Then,  given  any  (^(0)  >  0  €  TZ."**"*  with  the  appro¬ 
priate  block  diagonal  structure,  there  e^ts  an  o*  >  0  such  that  if0<a<a’,  the  sequence 
{^’‘(Q(O)]}^  vrill  converge  to  some  Q  >  0  satisfying  the  conditions  in  Theorem  2.1.  That 
is,  the  OCC  algorithm  will  converge  to  a  global  optimal  solution  of  the  given  OCC  problem. 

In  order  to  prove  Theorem  2.3,  we  need  a  few  intermediate  results  and  definitions.  .Let 
Q  —  >  0  be  given  and  let  K  denote  the  (unique)  stabilizing  solution  to 

Q  =  AlK  +  KA^  -  KB^R-^BjK  +  CjQC,  .  (2.28) 

Then,  with  the  state  feedback  gain  G  =  —BT^BJK,  the  /-th  output  covariance  of  the  closed 
loop  Yi  (/  =  1, 2,  •  •  • ,  m)  is  given  by 


Yi  =  CiXCf  , 

where  X  is  the  unique  solution  to 

0  =  (i4p  -f-  B^G)X  -i-  X{A,  -F  B^Gf  +  D„W,DJ  .  (2.29) 

Now,  let 

Q  =  block  dia^[Qj,  Qj, . . . ,  g„]  ;  g,  :=  ,  (2.30) 

and 

y‘  =  block  diag[YuY2,  •  •  ■  ,y„]  .  (2.31) 

Below,  we  compute  the  derivative  of  Y^  with  respect  to  the  weighting  matrix  Q  given  in 
(2.30).  We  do  this  using  vector  notation.  Let  Q  be  given  by  (2.30)  and  define  the  operator 
svec  by 


svec[Q]  = 


,1  1 


9^ 

L  <f' 


(2.32) 


34 


where 


<7*  v/2  rt’  „*  ^33  1  i  9m, m,- 


(2.33) 


Note  also  that  the  operator  3vec  defined  in  (2.32)  preserves  the  Frobenius  norm-  i.e.  if  Q 
given  by  (2.30)  we  have  ’  ’ 


IIQII  =  ||suec[(5]||  . 


Moreover,  3evc[-]  is  a  linear  operator. 
Let 


y  =  3vec{y*]  , 


where  is  given  by  (2.31).  Define  also  the  following  symmetric  matrix 


(2.34) 


(2.35) 


E,  =  3vec"*[c,]  ,  (2.36) 

where  e,-  €  'TV'  has  a  one  La  the  i-th  row  and  zeros  elsewhere,  and  3vec~^  is  the  inverse  of 
the  operator  svec. 


Lemma  2.3  Consider  the  system  defined  in  (1.1)  and  suppose  assumption  (Al)  holds.  Let 
g  =  >  0  6e  given  by  (2.30)  and  define  q  =  svec[g].  Let  y  be  given  by  (2.35).  Then,  the 

partial  derivative  of  y  £  TV'  with  respect  to  q  E  TV'  is 

^  =  -(iTi,)  =  -12(r<.ce(P,B,jr'B//>  A-)I ;  i, j  =  1, 2, . . . (2.37) 
where  Pi  is  the  unique  solution  to 

0  =  Pi{A,  +  B,G)  +  {A,  +  B.GfPi  +  C^EiC,  (2.38) 

with  Ei  given  by  (2.36).  Moreover,  1/ Q  =  >  0,  the  matrix-valued  function  H{Q)  =  [Hij] 

is  continuous  and  it  satisfies  H{Q)  >  0. 


Proof:  Let  y,-  denote  the  i-th  component  of  y.  From  the  definition  of  the  operator  svec  (see, 
for  example,  (2.32))  it  follows  that 

y.-  =  trace{EiCpXCj)  .  (2.39) 

Using  the  Lyapunov  equations  (2.29)  and  (2.38)  it  follows  from  (2.39)  that 

y,-  =  trace{PiDpWpDj)  ,  (2.40) 

where  P,-  is  the  solution  to  (2.38).  Hence,  from  (2.40),  we  get 

||  =  trac.{P,iD,W^D^),  (2.41) 

where  qj  is  the  y-th  component  of  q  and  P,.-  = 
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Now  to  generate  P.j,  differentiate  equation  (2.38)  with  respect  to  qj  to  obtain 


0  =  + 


(2.42) 


From  the  Riccati  equation  (2.28)  and  the  Lyapunov  equation  (2.38)  we  get 

^  dq:  ’ 

where  Pj  solves  (2.38)  with  the  “^-matrix”  equal  to  Ej.  Hence,  from  (2.42),  we  obtain 

P>i  =  -J"exp[iA,  +  B,Gft][P,B,jr^BjP, 

+PjB,ir^BjP,]exp[iA„  +  B,G)t]dt.  (2.43) 

Finally,  from  (2.29),  (2.41),  and  (2.43)  we  obtain 

dy 


dq 


=  -[Hij]  =  -[2trace{PB,R-^BjP,X)]  , 


(2.44) 


which  gives  (2.37). 

The  continuity  of  follows  from  the  fact  that,  on  the  set  of  positive  semidefinite 

matrices  Q,  the  matrix-valued  functions  Pi,  Pj,  and  X  are  all  continuous.  Note  also  that 

Hij  =  trace  (PiB^R-^BjPjX) 

=  <  X^^'^PiB^R-^l\X^f^PjB^Br^l^  >  , 

where  <  M,  N  >=  trac&MN^  is  the  standard  inner  product  on  the  space  of  matrices  7^’'*^’*’*^ 
where  n,  and  n„  are  dimensions  of  the  plant  states  and  controls.  Thus,  H  is  of  the  form 

Hij  =  [<  X^/^PiB^ir^l\X^f'^PjB^R-^l'^  >]  ,  (2.45) 

which  shows  that  /f  >  0.  □ 

The  following  resxilts  may  be  found  in  [11],  see  Proposition  3.2.3  and  Proposition  12.3.7. 

Lemma  2.4  Assume  that  T ;  7^"  — +■  7^"  is  Frechet-differentiable  on  a  convex  set  I^o  C  7^". 
Then  for  any  x  and  y  6  "Uq, 


ll^(y)--^(a:)||  <  sup  +  t(y  -  i)]}l|x  -  y||  ,  (2.46) 

0<t<l 

where  P'{-)  denotes  the  Frechet-derivative  of  P(-),  and  c[-]  denotes  the  maximum  singular 
value  of[-\. 


Lemma  2.5  Suppose  that  T  :  ig  nonexpansive  on  the  closed,  convex  set 

Vq.  That  is,  for  any  x,  y  €  Vq,  we  have 


l|T(y)-T(x)|I<||y-x||. 


(2.47) 
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Assume,  further,  that  TVo  C  'Do  and  that  Do  contains  a  fixed  point  o/T.  Then  for  any 
€  (0>  1)  3:°  €  Do  the  iteration 

X-*'  =  +  (1  -  ^)r(i‘)  ;  i  =  0, 1, . . . ,  (2.48) 

converges  to  a  fixed  point  ofT  in  Do. 


Proof  of  Theorem  2.3;  The  proof  of  Theorem  2.3  consists  of  two  steps.  First,  we  show 
the  nonexpansive  property  of  operator  T  defined  in  (2.17).  By  assumption,  there  exists  Q" 
satisfying  the  conditions  in  Theorem  2.1.  Define  a  subset  of  as  follows 

Do  :=  {Q>t)  block  diag[Qx,Q2,...,Qn\ 

<l|g(0)-<5*||}.  (2.49) 

where  rxy  is  the  dimension  of  yp,  and  Q(0)  is  the  initial  output  weighting  matrix  for  the  OCC 
algorithm.  It  is  obvious  that  the  set  Do  is  compact  (i.e.,  closed  and  bounded)  and  convex. 
Let  D'o  be  a  set  defined  by 

“Do  •'=  {?  =  svcc[Q]  €  'RT  :  Q  €  X^o}  •  (2.50) 

It  is  clear  that  D' o  is  convex,  for  svec[-]  is  a  linear  operator  and  Do  is  convex.  Let  ?  € 
and  define  y{q)  =  svec[y*((5)],  and 


.^?]  =  ?  +  ay(g) .  (2.51) 

Note  that  7^-]  is  well-defined  and  Frechet-differentiable,  with  respect  to  q,  in  D'o-  In  fact, 
from  Lemma  2.3,  it  follows  that  the  Frechet  derivative  of  is 

J^[q]  =  I-aH{q)  ,  (2.52) 

where  H{q)  is  defined  in  (2.37).  (Here,  we  think  of  if  as  a  function  of  g  =  svecfQ]  instead 
of  a  function  Q.) 

Now,  let  Q"  and  in  Do  be  given.  Define  g"  =  sveclQ'']  and  =  3vec[(5*‘].  Then, 
since  svec[-]  preserves  the  Frobenius  norm,  we  have 

\\T[Q'']-T{Q^]\\  =  \\P\Q'' -cc{Y^{Q‘')-Y")]-V[Q>^~a{Y\Q^)-Y"]]\\ 

<  IIQ*'  -Q^-  <y[Y\Qn  -  Y^iQ^)]\\  (2.53) 

=  Ik"  - 

where  y‘'  :=  svec[Y\Q‘')]  and  :=  svec[y^(Q^)].  Since  g*'  and  belong  to  D'o,  using 
Lemma  2.4,  we  have 

<  sup  wi^[t<i''  +  (1  -  ()?11lk‘'  -  ?“|| 

0<t<l 

=  sup  ^/-aif{[tg‘'  +  (l-f)g^]}]||g‘'-g^l|  (2.54) 
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Since  if  is  a  continuous  function  over  the  compact  set  'P'o,  there  exists  an  a*  >  0  such  that 
for  any  €  ^o>  9^  €  ind  0  <  f  <  1,  we  have 

+  (1  -  i)9l}  <  2/a*.  (2.55) 

Thus,  since  for  any  9"  and  €  P'0,  and  any  t  €  [0, 1],  if[t9*'  +  (1  -  >  q,  have 

^s^up  a{/  -  aH[tq''  +  (1  -  t)g^]}  <  1  (2.55) 

for  any  a  <  a*.  Therefore,  using  (2.53)  and  (2.54),  for  any  a  <  a*  we  obtain 

\\Tm  -  T[gil|  <  llg*'  -  9^11  =  \\Q^  -  Q-ll.  (2  ’7) 

Hence,  for  any  a  <  a*,  the  operator  T  is  nonexpansive  on  Vq.  Replacing  Q**  by  Q“  proves 
that  for  any  Q  €  Po 

mQ\  - rmw  <  \\Q  - <?’ll  <  IIQ(O)  -  g*il.  (2.58) 

Now,  using  Lemma  2.1  and  the  fact  that  Q”  satisfies  the  conditions  of  Theorem  2.1,  we 
conclude  that  T[Q‘]  =  Q*.  This  equation  and  (2.58)  imply 

mQ]  -  Q1  <  ll<3(0)  -  QT  (2.59) 

therefore,  T[Q]  €  Pq. 

Second,  we  shall  show  the  convergence  of  the  OCC  algorithm,  that  is,  the  convergence  of 
the  sequence  {T^[Qi^)\)%a.  Since  TPq  C  Pq,  Pq  is  convex,  and  it  contains  a  fixed  point  of 
T,  from  Lemma  2.5,  we  obtain  that  the  sequence  {T^^[Q(0)]}^  generated  by  the  iteration 

QU  + 1)  =  TplQU)]  =  W)  +  (1  -  mQ{j)\  (2.60) 

converges  to  a  fixed  point  of  T  in  Pq,  say  Q.  The  fact  that  Q  satisfies  the  sufficient  conditions 
in  Theorem  2.1  is  the  direct  consequence  of  Theorem  2.2.  □ 

2.2  The  OCC  Algorithm  for  Full  Order  Dynamic  Feedback 

The  extension  of  the  state  feedback  case  to  the  full  order  dynamic  feedback  case  is  straight 
forward.  In  fact,  the  state  feedback  OCC  algorithm  can  be  applied  to  solve  the  full  order 
dynamic  feedback  OCC  problem.  Here,  for  system  (1.1),  we  assume  that  assumption  (Al) 
holds  and  that 

(A2)  (Afp,  Ap)  is  detectable. 

As  is  well  known  [7],  under  assumption  (A2),  there  exists  a  unique  matrix  .iV  that  satisfies 
the  Riccati  equation 


0=:A,X  +  XA^  -  XMjV-'^M.X  +  (2.61) 

and  Ap  —  XMJV~^  is  asymptotically  stable.  Moreover,  A  >  0.  With  this  matrix  A,  we 
define 


F  =  XMJV-'^  . 


(2.62) 
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Theorem  2.4  Consider  the  plant  defined  in  (1.1).  Let  X  and  F  denote  the  matrices  in 
(2.61)  and  (2.62).  Suppose  there  exists  a  matrix 


Q-  =  block  diag[Ql  Ql  0  ;(?•  =  Qf  €  ;  i  =  1, 2, . . . ,  m,  (2.63) 

such  that  the  algebraic  Riccati  equation 

0  =  AjK  +  KA,~  KB,ir'BjK  +  CjQ'C,  (2.64) 

has  the  (unique)  stabilizing  solution  K’ .  Define 

G=-{r'BjK-,  (2,63) 

and  let  X  denote  the  unique  solution  to  the  Lyapunov  equation 

0  =  {A,  +  B,G)X  +  X{A,  +  B,Gf  +  FVF^  ,  (2.66) 

and  define  Yi  =  Ci(X  +  X')Cf  (i  =  1,2, . . .  ,m).  Then,  if 

0  =  {Yi-Yi)Q:andY<Yi  (2.67) 

for  all  t  =  1, 2, . . . ,  m,  the  dynamic  controller 


i.{t)  =  {A^^B,G-FM,)x,{t)  +  Fz{t) 

u{t)  =  Gx,(i)  (2.68) 

is  an  optimal  solution  to  the  OCC  problem  defined  in  (1.7). 

A  proof  of  this  theorem  may  be  obtained  by  combining  Theorem  2.1  in  this  paper,  and 
Lemma  4.2  and  Theorem  4.1  in  [12].  The  result  in  [12]  shows  how  to  reduce  the  OCC 
problem  (and  other  T^j-like  problems)  with  output  feedback  to  an  equivalent  problem  with 
state  feedback. 

Note  that  the  matrices  X  and  F  in  (2.61)  and  (2.62)  do  not  depend  on  the  weighting 
matrix  Q".  To  find  a  matrix  Q‘  satisfying  the  conditions  in  Theorem  2.4,  we  can  use  the 
OCC  algoritlm  given  in  Section  2.  This  requires  that,  in  the  OCC  algorithm,  we  replace 
^pi  ^pi  3Jid  y,-  by  i^,  V,  cind  Yi  —  CiXCj,  respectively. 


3  Discrete- Time  Version 

The  discrete-time  version  of  the  OCC  problem  is  very  much  like  the  continuous-time  case. 
Here,  we  give  the  definition  of  the  OCC  problem  and  the  main  results. 

Consider  the  following  discrete  system 

Xp{k  -M)  =  Aj,Xj,{k)  -I-  Bpu{k)  A  DpWp{ky 

yp(k)  =  CpXp{k)  (3.1) 

z{k)  =  AfpXpik)  +  v{k)  . 
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(3.2) 


Suppose  that  to  the  plant  (3.1)  we  apply  a  full  state  feedback  stabilizing  control,  i.e., 

u(k)  =  Gx{k) 

or  a  strictly  proper  stabilizing  control 

^e(i  +  l)  =  A,x,{k)  +  Fz{k) 

u{k)  =  Gxe{k)  .  (3.3) 

Then  the  closed  loop  system  has  the  following  form 

x(l;  +  l)  =  Ax{k)  +  Dw(k) 

1  =  [  c!  ] 

where  the  defimtions  of  matrices  A,  B,  C  and  vectors  r,  tn,  y  are  as  in  the  continuous- time 
case. 

As  in  Section  1,  let  >  0  and  V  >  0  denote  symmetric  matrices  with  dimensions 
equal  to  the  dimensions  of  tOp  and  z,  respectively.  Define  W  =  Wp  if  (3.2)  is  used  in  (3.4), 
or  PV  =  block  diag\^p^  V]  if  (3.3)  is  used.  Let  X  denote  the  closed  loop  controllability 
gramian  from  the  input  Since  A  is  stable,  X  is  given  by 

X  =  AXA^  -I-  DWD^  .  (3.5) 

As  in  the  continuous-time  case,  we  seek  a  solution  to  the  following  optimal  control  prob¬ 
lem: 


The  Discrete-Time 


Probler 


Find  a  state  feedback  stabilizing  controller  (3.2)  or  a  strictly  proper  output  feedback  stabi¬ 
lizing  controller  (3.3)  for  the  system  (3.1)  to  minimize  the  OCC  cost 


Jocc  =  traceRCuXC^  ,  R>  Q 


(3.6) 


subject  to 

Yi  =  CiXCf  <  F,  ;  i  =  1, 2, . . . ,  m,  (3.7) 

where  X  is  given  by  (3.5).  □ 


The  discrete-time  OCC  problem  has  interpretations  similar  to  the  ones  of  the  continuous¬ 
time  case.  For  example,  the  discrete-time  OCC  problem  may  be  interpreted  as  the  problem 
of  minimizing  a  weighted  sum  of  the  worst-case  peak  values  of  the  control  signals  u,-  subject 
to  constraints  on  the  worst  case  peak  values  of  the  response  y,-,  when  the  disturbance  w  is 
unknown  but  has  bounded  energy.  This  is  because,  as  in  the  continuous-time  case,  discrete- 
time  gains  from  £2  to  £(„  may  also  be  computed  using  controllability  gram j an s  [18], 
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3.1  State  Feedback  Case 

In  tlm  sub-section  we  consider  the  c^  of  state  feedback.  The  foUowing  theorem  provides 
conditions  for  globaJ  optimality.  Its  proof  is  similar  to  that  of  Theorem  2.1  and  it  is  omitted. 

Tii6oreni  3.1  Suppose  theve  exists  a  Tnatrix 


Q' =  block  diag[QlQ;,...,Q-J  >Q.  Q- =  Qf  e  ;  i  =  1, 2, . . . ,  m. 

such  that  the  algebraic  Riccati  equation 

K  =  AjKA,  -AjKB,{R  +  B^KB,r'BjKA,  +  CjQ'C, 

has  the  (uniqae)  stabilizing  sclation  K' .  Define 


(3.3) 


(3.9) 


g-  =  -ir^bJicb,)-'bJk-a,.  (3.10) 

and  let  X  dtuotc  the  unique  solution  of  the  Lyapunov  equation 

X  =  {A,  +  B,Cr)X{A,  -I-  B.Cf  +  D,W,Dj  ,  (3.11) 

and  define  Y;  =  CiX'Cj  (i  =  1, 2, . . . ,  mj.  Then,  if 

0  =  {Yi-  Yi)Q:  and  Y  <  Yi  (3.12) 

for  all  i  =  1,2, loe  have  that  given  by  (3.10)  is  an  optimal  solution  to  the  OCC 
problem  defined  in  (3.6). 


The  following  algorithm  may  be  used  to  find  a  matrix  Q',  and  consequently  a  matrix  G' 
for  the  OCC  problem,  satisfying  the  conditions  in  Theorem  3.1. 

The  Discrete-Time  OCC  Algorithm 

1)  Given  A^,  B^,  D^,  Cp,  W,,  R,  F.-  =  block  diag[Yi ,  Fj, . . . ,  F„],  an  initial  point  Q{0)  = 

block  <fK*^[(?i(0),Q2(0),--.,QTT»(0)]  >  0,  and  constants  o  >  0,  0  <  <  1,  let  j  =  0 

and  go  to  2). 

2)  Compute  K(j)  >  0  and  G(j)  by  solving 

KU)  =  A^KU)A,  +  CJQU)C, 

-AlK(j)B,lR  +  BJKU)B,]-'BJKU)A,  (3.13) 

GU)  =  -IR  +  BJKU)B,]-'BJKU)A,. 

3)  Compute  X{j)  by  solving 

^U)  =  (Ap  +  B,G{j)]XU)[A,  +  B,G{j)f  -b  D,W,D^.  (3.14) 

4)  Set  Y{j)  =  CiXij)CT  for  «■  =  1,  2, . . . ,  m. 
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(3.15) 


5)  Let  y‘(;)  =  block  diag[Y,{Q{j))^  YziQij)) . YrrsiQU))], 

Q{j  + 1)  =  ^QU)  +  (1  -  mQU)  +  criY^j)  -  F*}| , 

;  = ;  + 1,  go  to  2). 

In  (3.15),  the  operator  V[‘]  is  as  defined  in  (2.12).  □ 

The  same  stop  criterion  as  the  continuous- time  case  is  proposed  for  the  discrete-time  OCC 
algorithm.  That  is,  equation  (2.16)  needs  to  be  tested  after  step  4)  for  a  given  tolerance 

€  >  0.  If  (2.16)  holds,  G{j),  Q\{j),  Qi{j),  and  Qm{j)  are  numerical  solutions  for  the  given 
OCC  problem;  else,  the  algorithm  continues. 

In  the  rest  of  this  section,  we  will  assume  the  following; 

(A3)  (Ap,  Bp)  is  stabilmable  and  Ap  has  no  eigenvalues  on  the  unit  circle. 

Note  that  the  discrete-time  OCC  algorithm  is  well-posed  in  the  sense  that  the  unique  posi¬ 
tive  semidefinite  solution  K{j)  to  the  Riccati  equation  (3.13)  and  the  solution  X{j)  to  the 
Lyapunov  equation  (3.14)  exist  at  each  iteration.  This  follows  from  assumption  (A3)  and 
the  fact  that,  at  each  iteration,  Q{j)  >  0.  As  is  well  known  [8],  since  {Ap,Bp)  is  stabilizable 
and  the  pair  {Q{j)^^^CpyAp)  has  no  unobservable  modes  on  the  unit  circle,  K{j)  >  0  exists 
it  is  unique,  and  it  renders  Ap  -  Bp(R  -|-  BjKij)Bp)-'^BjK{j)Ap  asymptoticaUy  stable. 

A  close  examination  of  the  proofs  of  the  continuous- time  results  given  in  Theorems  2.2 
and  2.3  reveals  that  the  convergence  property  of  the  continuous-time  algorithm  follows  from: 

i)  The  properties  of  the  operator  "P[*]  given  in  Lemma  2.1. 

ii)  The  properties  of  the  stabilizing  solution  to  the  continuous-time  Riccati  equation  given 

in  Lemma  2.2. 

iii)  The  formula  for  the  derivatives  of  the  output  covariance  matrices  Yi{Q),  YilQ)  ,  . .., 
Ym{Q),  with  respect  to  Q,  given  in  Lemma  2.3. 

Certainly,  property  i)  above  holds  in  the  discrete-time  case  because  the  operator  'P[-]  is 
the  same.  Also,  it  is  relatively  easy  to  show  that,  under  assumption  (A3),  property  ii)  extends 
to  the  discrete-time  setting.  Finally,  property  iii)  above  also  holds  in  the  discrete-time  case, 
provided  that  the  Lyapunov  equation  (2.38)  is  replaced  by  its  discrete-time  counterpart,  and 
the  matrices  R  and  AT  in  (2.37)  are  replaced  by  R  +  BjKBp  and  AT  -  DpWpDj,  respectively. 
Thus,  we  may  now  conclude  the  following  result. 

Theorem  3.2  Suppose  that  the  assumption  (A3)  holds.  Assume  also  that  there  exists  Q’ 
satisfying  the  conditions  in  Theorem  3.1.  Then,  given  any  (5(0)  >  0  €  vjith  the 

appropriate  block  diagonal  structure,  there  exists  an  a"  >  0  such  that  if  0  <  a  <  a",  the 
sequence  {T'J[Q(0)]}j^  will  converge  to  some  Q  >  0  satisfying  the  conditions  in  Theorem 
3.1.  That  is,  the  discrete-time  OCC  algorithm  will  converge  to  a  global  optimal  solution  of 
the  given  OCC  problem. 
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3.2  Full  Order  Dynamic  Feedback 

As  in  the  continuous- time  case,  the  discrete- time  state  feedback  results  can  be  readily  ex¬ 
tended  to  solve  the  discrete-time  OCC  problem  with  output  feedback. 

Consider  the  system  (3.1)  and  suppose  that 

(A4)  (A/p,  Ap)  is  detectable. 

Then,  there  exists  a  unique  matrix  X  that  satisfies  the  Hjccati  equation 

X  =  A,XA^  -  A,XMJ(V  +  M,XMj)-'M,iAl  +  (3.16) 

and  Ap~  ApXMj{V  +  is  asjrmptotjcaUy  stable;  see,  for  example,  [8).  More- 

over,  ^  >  0.  With  this  matrix  X,  we  define 


F  =  A^M^{V  +  M,XMj)-^  .  (3.17) 

The  next  result  gives  a  solution  to  the  OCC  problem  with  strictly  proper  output  feedback 
controllers,  the  proof  follows  the  continuous-time  case  and  it  is  omitted. 

Theorem  3.3  Consider  the  plant  defined  in  (3.1).  Let  X  and  F  denote  the  matrices  in 
(3.16)  and  (3.17).  Suppose  there  exists  a  matrix 


Q-  =  Uock  diag[Q\,  QJ, . . . ,  Q);]  >  0  ;  (?*  =  Qf  €  =  1, 2, . . 

such  that  the  algebraic  Riccati  equation 

K  =  A^KA^-  A^KB.iR  -f-  +  CjQ-C, 

has  the  (unique)  stabilizing  solution  K’ .  Define 

G=-{R  +  BjK'B^y^BjK'A, , 
and  let  X^  denote  the  unique  solution  to  the  Lyapunov  equation 

a:  =  (Ap  -h  B^G)X{Ap  +  B,Gf  -b  F{V  -f-  MpXMj)F^  , 
and  define  Yi  =  Ci(X  -F  X^)Cl  (i  =  1,2, ...  ,m).  Then,  if 

0  =  {Y-Yi)Q:andYi<Yi 
for  all  i  =  1,2,...,  m,  the  dynamic  controller 

x,(^-M)  =  {A^  +  B,G-FM^)x,[k)  +  Fz{k) 
u{k)  =  Gx^ik) 


m, 


(3.18) 

(3.19) 

(3.20) 

(3.21) 

(3.22) 

(3.23) 


is  an  optimal  solution  to  the  OCC  problem  defined  in  (3.6). 

Note  that,  as  in  the  continuous-time  case,  the  computation  of  X  and  F  are  independent 
of  the  selection  of  the  output  weighting  matrix  Q.  Hence,  we  can  apply  the  discrete-time 
OCC  algorithm  with  state  feedback  to  solve  the  discrete-time  full  order  output  feedback  OCC 
problem  under  the  assumption  that  the  optimal  solutions  are  strictly  proper.  This  requires 
that  in  the  algorithm  given  in  Section  3.1,  we  replatce  Dp,  Wp,  eind  Y,  by  F,  y  -f  MpXAfJ, 
and  Yi  —  CiXCj ,  respectively. 
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4  An  Example 

We  conaider  the  continuous-time  OCC  problem  defined  in  (1.7)  for  the  plant  (1.1)  with  the 
following  system  matrices: 


[0  1  01  [O' 

Ap  =  -1  -0.1  1  ;  Bp=  0  ;  Dp  = 

.0  0  -10  J  [  1  J 

A/;,  =  [  1  1  0  ]  ; 

‘1  0.5  0  ■ 

Cp  =  0  0  0.5  . 

.11  0  _ 

Both  the  process  noise  Wp  and  the  measurement  noise  v  are  scalar  variables,  while  the 
performance  variable  j/p  has  three  components.  The  weighting  matrices  required  to  define 
the  OCC  problem  (1.7)  are  taken  to  be 

Wp  =  1  ,  V  =  0.01  ,  and  R  =  I  .  (4-2) 

Below,  we  consider  two  different  OCC  problems.  These  two  problems  differ  in  the  grouping 
of  the  performance  variables  y,-  used  to  define  the  constraints  (1.6).  For  each  problem,  we 
consider  both  state-feedback  and  dynamic  output  feedback. 


4.1  Problem  1 

Here,  the  OCC  problem  has  the  performance  constraints 

Yi  <  0.035  ,  Yi  <  0.050  ,  Ka  <  0.050  ,  (4.3) 

where  Yi,  Vj,  and  Y^  denote  the  output  covariance  (1  x  1)  matrices  introduced  in  (1.6), 
corresponding  to  the  first,  second,  and  third  performance  variable  respectively.  Note  that 
this  OCC  problem  can  be  also  solved  by  the  ellipsoid  algorithms  given  in  [1,  3,  12]  or  the 
quadratically  convergent  algorithms  given  in  [16]. 

First,  we  consider  the  case  of  state  feedback.  We  use  the  algorithm  described  in  Section 

2.1  with  the  following  parameters 

Q(0)  =  /3  ,  ^  =  0.1  ,  £  =  10-®  .  (4.4) 

To  asses  the  effect  of  the  user-specified  parameter  a,  we  ran  the  the  algorithm  with 
1.0  <  a  <  7.25.  Figure  1  shows  the  number  of  iterations  required  to  meet  the  stopping 
criteria  of  the  algorithm  versus  a.  Clearly,  as  a  approaches  1  or  7.25  the  iteration  number 
increases.  From  Figure  1,  it  follows  that  there  exists  an  optimal  a  which  uses  the  least 
number  of  iterations.  Finding  such  an  optimal  a  in  terms  of  the  system  and  specification 
matrices  remains  an  op>en  problem. 

Table  1  shows  the  results  of  running  the  algorithm  with  a  =  4.5.  Both  state  and  output 
feedback  cases  are  computed.  In  the  state  feedback  case,  G  denotes  the  state  feedback  gain. 
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In  the  output  feedback  case,  G  denotes  the  controller  output  matrix,  see  (2.65)  and  (2.68). 
The  controller  input  matrix  F  is  precomputed  according  to  (2.62).  In  this  case  we  have 

F  =  [  0.4412  0.7633  0.4796  f  .  (4.5) 

From  Table  1,  we  can  see  that  both  controllers  are  feasible,  for  Y,  satisfies  the  bound  Yi  <  Yi. 
The  only  active  constraint  is  the  third  one,  i.e.  Yi  =  Yz',  hence,  the  corresponding  output 
weight  Qz  is  nonzero.  As  expected,  the  optimal  cost  Jocc  with  output  feedback  is  bigger 
than  that  with  state  feedback. 

4.2  Problem  2 

Now,  the  OCC  problem  has  the  performance  constraints 

yi  <  0.03o  ;  Yz  <  0.050  x  h  ,  (4.6) 

where  Yi  denotes  the  (1x1)  output  covariance  matrix  corresponding  to  the  first  performance 
output,  and  Yi  the  (2  x  2)  output  covariance  matrix  of  the  second  and  third  performance 
outputs  grouped  together. 

Table  2  shows  the  results  of  running  the  algorithm  with  a  =  30  for  both  state  and  output 
feedback  cases.  The  other  parameters  required  by  the  algorithm  axe  those  in  (4.4).  For  the 
output  feedback  case  the  input  gain  matrix  F  of  the  controller  given  in  (4.5). 

From  Table  2,  we  can  see  that  both  controllers  are  feasible.  As  expected,  the  optimal 
cost  Jocc  with  output  feedback  is  bigger  than  that  with  state  feedback.  Also,  note  that  the 
constraint  on  the  second  output  group  Yj  <  0.05  x  Iz  is  sufficient  for  the  output  covariance 
constraints  of  Problem  1  in  (4.3),  that  is,  Yz  <  0.05  and  Yz  <  0.05.  As  expected,  the  cost 
of  Problem  2  for  both  state  and  output  feedback  cases  are  bigger  than  those  of  Problem  1, 
respectively. 
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_ _ State  Feedback  Design 

Iteration  Constraints  |  Optimal  Cost 

Number  apec.  (y.)  |  Actual  (YA  Jnrr 


0.0350  0.0314 

9  0.0500  0.0123  0.0234 

_ 0.0500  0.0500 


_ _ Output  Feedback  Design 

Iteration  _ Constraints _  Optimal  Cost 

Number  f  5pec.  (F.)  |  Actual  (K)  Jocc 


0.0314 

22  0.0500  0.0126  0.0340 

0.0500  0.0500 


0.0000  0.0193 
0.0000  -1.3839 


U.U500  I  O.OoOO  I _  2.3765  |  -0.1374 

Table  1:  Solution  to  Problem  1  with  a  =  4.5. 


_ _ _ _ _ _ State  Feedback  Design 

Iteration  Constraints  Optimal  Cost 

Number  [  Spec.  (F.)  |  Actual  {YH  Jqcc 


0.0300 


0.050  x/2 


Iteration 


Constraints 


0.0235 


Output  Feedbcick  Design 


Number  [  Spec,  (y.)  |  Actual  (p;) 


0.0350 

60  I 

0.050 x/2  , 

Optimal  Cost 
Jocc 


0.0341 


Qi 


0.0000 
019  0.052 
527  1.427 


Qi 


0.0000 
0.0035  0.09 
0.0919  2.38 


0.0212 

-0.9542 

-0.0950 


Table  2:  Solution  to  Problem  2  with  a  =  30. 


5  Conclusion 


In  this  paper  we  have  considered  the  so-called  Output  Covariance  Constraint  (OCC)  control 
problem.  This  is  the  problem  of  minimizing  control  effort  subject  to  matrix  inequality  con¬ 
straints  on  several  closed  loop  covariance  matrices.  Optimality  conditions  for  characterizing 
a  global  solution  are  provided.  In  the  state-feedback  case,  these  conditions  comprise  one 
dgebraic  Riccati  equation,  one  Lyapunov  equation,  and  a  coupling  condition.  The  unknown 
in  this  system  of  equations  is  a  matrix  Q  which  may  be  interpreted  as  a  matrix  of  Kuhn- 
Tucker  multipliers.  We  have  given  an  iterative  algorithm  to  find  such  a  matrix  Q.  Under 
the  aMumption  that  the  optimality  conditions  admit  a  solution  C?,  we  have  shown  that  the 
iterative  algorittun  converges  to  one  such  solution,  provided  the  step  size  parameter  a  is 
properly  chosen.  Using  the  separation  property  of  a  closed  loop  covariance  matrix  given  in 
[12],  we  have  shown  how  to  modify  the  state- feedback  algorithm  to  solve  the  OCC  prob¬ 
lem  with  output  feedback.  Both  discrete  and  continuous  time  problems  have  been  solved. 
Finally,  an  example  is  presented  to  demonstrate  the  applicability  of  our  results. 
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COVARIANCE  ACTIVE/PASSIVE  CONTROL 
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1293  Potter  Engineering  Center,  Purdue  University 
West  Lafayette,  IN  47907-1293 

ABSTRACT 

An  integrated  means  for  active  controller  design  and  structure  redesign  is  presented.  The  tech¬ 
niques  of  covariance  control  are  used  to  parametrize  all  possible  combinations  of  active  con- 

troUers/structure  redesign  parameters  which  can  stabiHze  the  plant,  and  achieve  certain  closed-loop 
performance. 


1.  INTRODUCTION 

To  cope  with  the  demanding  task  of  structural  control  problems,  one  can  improve  performance 
by  combining  both  the  design  of  active  controllers  and  the  design  of  the  structure.  The  term 
’’Smart  Structures”  implies  the  use  of  feedback  control  sensors  and  actuators  imbedded  in  a  material 
structure  to  improve  the  dynamic  response.  Until  now,  the  design  of  the  controller  parameters  and 
the  structural  material  parameters  have  not  been  integrated  and  combined  to  guarantee  any  specific 
performance.  Existing  methods  can  choose  the  controller  and  structure  parameters  by  trial  and 
error  or  by  gradient  approaches  to  nonlinear  programming  problems. 

These  computationally  intensive  approaches  are  devoid  of  physical  insight,  do  not  guarantee 
stability,  and  make  no  attempt  to  produce  all  stabilizing  solutions.  Such  is  the  goal  of  this  paper, 
to  show  the  explicit  relationship  between  all  stabilizing  state  feedback  control  gains  and  the  struc¬ 
tural  parameters.  If  an  initial  structure  is  given,  and  if  a  controller  which  satisfies  performance 
requirements  (closed-loop  stability,  tracking  accuracy...  etc.)  is  given,  the  necessary  and  sufficient 
condition  is  known®-’’  for  the  existence  of  structure  redesign  parameters  to  duplicate  the  closed- 
loop  system  performance  while  minimizing  the  active  control  effort.  This  condition  derived  from 
the  above  setting  is  convex  in  the  structural  redesign  parameters,  and  hence  a  global  minimum  is 
guaranteed,  as  weU  as  stability. 


The  drawback  in  this  past  approach®-’  is  that  we  are  given  a  controller  before  hand,  hence  the 
space  in  which  we  search  for  the  optimum  is  necessarily  restricted  by  this  fact.  In  other  words,  it 
is  possible  that  beginning  with  another  controller,  we  can  reduce  the  control  effort  even  more.  We 
seek  to  simultaneously  redesign  the  structure  and  the  controller.  The  above  algorithm®-’  does  not 
necessarily  solve  this  problem,  even  if  applied  iteratively. 


To  obviate  this  difficulty  we  will  use  the  covariance  control  technique®-^-^,  which  provides  a  way 
to  parametrize  all  stabilizing  controllers  in  terms  of  a  physically  meaningful  state  covariance  X, 
and  the  stabiliz ability  conditions  derived  in  the  theory  for  active  control  forms  a  parametrization  of 
the  set  of  aU  assignable  covariances  as  function  of  structure  parameters  only  (without  the  control 
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gains). 


In  this  paper,  we  first  present  the  problem  formulation  in  section  2,  and  the  main  results  are 
introduced  in  section  3.  We  give  2  examples  in  section  4,  and  in  section  5,  a  short  discussion  of 
future  directions  is  given.  All  proofs  are  given  in  appendices. 

2.  PROBLEM  FORMULATION 

We  shall  limit  our  attention  to  linear  systems,  although  some  advantages  of  our  approach  extend 
also  to  nonlinear  systems.  Assume  that  the  equations  of  motion  for  the  linear  elastic  structure  have 
been  put  into  the  finite  dimensional  state  form. 


X  =  Ax  +  Bu  -f-  Dw 


u  =  GaX  (2) 

Where  w(t)  is  a  zero  mean  white  noise  (including  actuator  noise)  with  intensity  W,  and  is  the 
state  feedback  control  gain  to  be  designed. 


For  a  given  state  covariance  X  >  0,  the  necessary  and  sufficient  condition  for  the  existence  of 
a  Ga  which  assigns  this  X  was  derived  by  Yasuda  and  Skelton®  as 

iI-BB+)Q{I-BB-^)  =  Q  (3) 

Q  =  AX  XA*  +  DWD* 

and  the  set  of  Ga  that  satisfies  the  requirement  is  parametrized  as: 

Ga  =  -^5+g(2/  -  +  R+5RR+X-1  +  (/  -  BB^)Z  (4) 

Since  w  includes  actuator  noise,  then  D  has  the  structure  D  =  [B,i?2],  and  stabilizability  (con- 
troUability)  of  (A,B)  impHes  stabifizability  (controUabiUty)  of  (A,D).  We  assume  controUability  of 
(A,B)  to  simplify  the  presentation.  If  (A,B)  is  controllable,  then  X  >  0  is  equivalent  to  {A  +  BGa) 
stable.  Hence,  since  (3)  parametrizes  aU  X  >  0  that  can  be  assigned  to  the  system.  Condition  (3), 
with  X  >  0,  is  also  a  necessary  and  sufficient  condition  for  stabifity  of  the  closed  loop  system. 

The  significance  of  state  covariance  is  well  known.  A  system  must  be  stable  to  have  a  bounded 
covariance,  and  almost  aU  robustness  properties  of  linear  systems  (disturbance  rejection,  struc¬ 
tured  and  unstructured  parameter  robustness)  can  be  related  directly  to  properties  of  the  state 
covariance^’^. 


Note  that  the  control  gain  G  in  (4)  is  an  explicit  function  of  the  covariance  X  and  the  plant 
(structure)  data  (A,B).  If  we  can  relate  a  set  of  closed-loop  performance  requirements  to  an  X  >  0, 
then  all  control  gains  that  assign  this  X  to  the  system  are  given  by  (4).  Let  Aq  denote  the  original 
structure,  and  Gp  denote  the  changes  in  the  structural  parameters  that  are  allowed.  Now  if  we 
write  A(system  matrix)  as 
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A  =  Ao  +  BpGpMp  (5) 

The  structure  of  the  connectivity  matrices  Bp,  Mp  allow  changes  in  the  system  matrix  to  be 
accomplished  in  a  physically  achievable  way. 


We  call  Gp  the  “passive  controller.”  The  closed-loop  system  matrix  looks  like  so, 


—  Aq  -p  BpGpMp  BGa  ■  (6) 

The  question  is,  given  a  desired  state  covariance  >  0,  is  there  a  {Gp,  Ga)  pair  to  assign  this 
X?  This  is  equivalent  to  asking  the  stabilizability  question,  since  every  stable  system  has  a  finite 
positive  X  >  0.  If  it  is  stabilizable,  we  desire  the  set  of  all  {Gp,  Ga)  which  stabilize  the  system. 

3.  MAIN  RESULT 


Theorem  1  A  state  feedback  system 

i  —  (A  -|-  BpGpMp)x  -|-  Bu 
U  =  GaX 

is  stabilizable  by  some  Gp,  Ga  iff  there  exists  X  >  0  satisfying 

<  PmPQPPm  =  0  (7) 

\  [(/  -  PAt/3/3+)(P>,/3/3+)+]  PmPQP  =  0 

where 

P  =  {I-BB+)  Q  =  {XAl  + AqX  A  DWD*) 

(}  =  PBp  M  =  MpXP 
Pp  ^  {I-p/3-^),  Pm  =  {I-M+M) 

Proof.  See  Appendix  A. 

The  conditions  shown  in  (7)  are  similar  to  the  covariance  assignability  conditions  derived  in® 
for  the  measurement  feedback  system.  This  similarily  is  due  to  the  fact  that  the  plant  redesign  part 
BpGpMp  is  mathematically  equivalent  to  measurement  feedback,  and  we  take  advantage  of  this  fact 
in  our  proof  for  Theorem  1.  Next,  compare  (3)  (interpret  with  Aq  in  lieu  of  A)  with  (5)-(7),  we 
can  see  that  the  set  of  assignable  X  is  enlarged  because  of  the  added  flexibility  of  plant  redesign. 
(Conditions  (5)-(7)  are  less  restrictive  than  (3).  Any  X  which  satisfies  (3)  will  automatically  satisfy 
(5)-(7),  but  the  reverse  is  not  true.) 


The  next  theorem  gives  the  parametrization  of  active  and  passive  covariance  controllers. 
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Theorem  2  Suppose  X  is  cssignable.  Then  all  (Gp^  Ga)  that  assign  X  to  the  systetn  are  given  by: 


Where 


Ga  =  -\B^[Q^BpGpMpX^XM;G;B;  +  P^^^{P^^y 

-P+$P+Fa]X-l  +  £+(/-  P^P,)S,{I  -  P+Pa)+  +  Pa^a 
Gp  =  -^/3+[PQP  +  P+$p-(P+$pr-i;$pP+Pp]M+ 

+/?+(/  -  i+Pp)5p(/  -  P+Pp)A<+  +  Zp  -  p-^pZpMM+ 


1  -  M^M 


$  =  -P{Q  +  B^G^M^X  +  XMIGXB* 


$  A 


-/  +  /?/?+ 

-/  +  M+X 


p  pj 


PQP 


(8) 

(9) 


and  (3,  P,  Q,  ,  M.,  are  defined  as  in  Theorem  1.  Sa,  Sp  are  arbitrary  skew- symmetric  matrices, 
Za,  Zp  are  arbitrary  matrices  of  proper  dimension. 


Proof.  See  Appendix  B. 

Note  that  we  have  4  free  parameters,  i.e.,  {Sa,  Sp,  Za,  Zp)  in  the  characterization  of  {Gp,  Ga)- 
These  free  parameters  provide  us  with  additional  freedom  for  further  optimization  of  a  secondary 
objective  (for  example,  searching  for  lowest  fuel  consumption  or  highest  precision  etc.),  without 
changing  the  closed-loop  state  covariance. 


In  the  following  examples,  we  will  show  that  with  the  additional  freedom  of  plant  redesign,  we 
can  achieve  closed-loop  performance  which  is  not  feasible  with  active  control  alone. 


4.  EXAMPLE 

Example  1.  Single  Mass,  Spring  and  Damper 


The  original  system  with  active  control  only  is 


X  =  Ax  +  Bu  -I-  Dw 

U  =  GaMaX 


A  = 


0  1 

-2  -3 


,  -'“a 


B  = 

'  0  ' 

D  = 

'  o' 

Ml  = 

’  1  ' 

1 

2 

p 

0 

From  (3),  we  can  derive  the  assignable  set  of  covariances  as 

a  0 

Aa  — 

where  Xa  satisfies 


0  - 
”  3 


a  >  0 
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0  =  Xa{A  +  BGaMaf  +  (A  +  BGaM,)Xa  +  DD^  . 

With  simultaneous  plant/control  design 

i  =  ( A  +  BpGpMp)x  +  BaU  +  Dw  , 
the  set  of  assignable  closed  loop  covariances  is 

X  —  ai  >  0,  02  >  0. 

U  02 

where  X  satisfies 

0  =  X{A  +  BpGpMp  +  BaGaMaf  +  (A  +  BpGpMp  +  BaGaMa)X  +  DD'^  . 

It  is  obvious  that  the  set  of  all  assignable  covariances  by  active  control  gain  Ga  is  included  in 
the  set  by  the  simultaneous  plant/control  design,  i.e.,  the  addition  of  plant  redesign  has  enlarged 
the  set  of  assignable  covariances,  and  consequently,  the  closed- loop  performance  capability. 
Example  2.  Euler  Bernoulli  Beam,  2  modes. 

Consider 

X  =  {A-\-  BpGpMp)x  -f-  BaU  -t-  Dw 

where 


^  ^  [  -0.7236  0.4472  1  [  0.2764  0.4472  1 

^  [  0.4472  -0.2764  0.4472  0.7236 


54 


Substitute  Gp  into  Ga,  then,  from  (8), 


Ga  =  [-0.5  -0.4702  -  1  -  0.7608]  +  Ga25aC?a3 

-^GaiZpGaS  +  GaeZjGaT 

Where  Sa  is  arbitrary  skew  symmetric  and  Zp  arbitrary. 


[0  0.4702  0  0.7608] 

0  0  0  O' 

0.2248  1.9775  -2.2228  0.8048 

0  0  0  0 

0.3637  3.1998  -0.5967  1.3022 

[-0.2351  -  0.3804] 

-0.0517  1.5453  0.5111  -0.1850  ' 

-0.1737  -1.5278  1.7173  1.3782 

[-0.0547  -0.1816] 

’  0.2248  1.9775  -2.2228  0.8048  ‘ 

0.3637  3.1998  -3.5967  1.3022 

Hence  Gp{Zp)  and  Ga{Zp,Sa)  form  all  possible  combinations  of  active  and  passive  controllers  that 
are  stabilizing. 

5.  CONCLUSION 

All  controllers  (passive  and  state  feedback  active)  that  assign  a  specified  covariance  are  parametrized. 
These  parametrizations  are  expressed  in  terms  of  system  matrices  only.  The  next  step  will  be  to 
expand  the  theory  to  measurement  feedback  system  and  systems  with  dynamic  controllers,  and  to 
apply  the  theory  to  specific  smart  structure  problems. 

6.  APPENDIXES 


Ga2  = 

Ga3  = 

(jo4  = 
Gab  = 
Ga6  = 
Gal  = 


Appendix  A.  Proof  of  Theorem  1. 

For  state  feedback  system  (l)-(2)  if  X  >  0  is  assignable,  we  have 

(/  -  BB+){XA*  +  AX  +  DWD*){I  -  BB-^)  =  0  (10) 

Now  let  A-Ao  +  BpGpMp. 

From  (10).  => 

(/  -  BB^){X{Ao  +  BpGpMpY  +  {Aa  +  BpGpMp)X  +  DWD*){I  -  BB+)  =  0  (11) 

Let  P  =  {I-  BB+ )  Q  i  {XAl  +  A^X  +  DWD*). 

From  (11).  ^ 

p{xm;g;b;  +  BpGpMpX)p  =  -pqp 
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PBpGpM^XP  =  --{PQP  +  Sk)  S*k  =  -Sk 

(12) 

Let  /3  =  PPp,  M  =  MpXP. 

For  GpM  to  have  solution: 

=>  OGpM  = -^{PQP  +  Sk) 

(13) 

For  /JGp  to  have  solution 

(/-/3/?+)(pgp  +  5fc)  =  0 

(14) 

(PQP  +  Sk){I  -  Af+A4)  =  0 

(15) 

It  is  easy  to  prove  that  (14),  (15)  are  necessary  and  sufficient  conditions  for  the  existence  of  Gp. 
Next,  solve  5^,  because  Sk  is  skew-symmetric. 

=>  jSk  is  Hermitian. 


From  (14)  ^  {I- P(3+){jSk)  =  -jiI-/3p+)PQP  (16) 

From  (15)  USk}{I  -  M+M)  =  -jPQP[I  -  M+M]  (17) 

We  need  the  following  lemma: 

Lemma  1  AX  =  C,  XB  =  D  has  common  Hermitian 

Solution  X  is  and  only  if  these  two  equations  have  common  solution  and 


H*  =  H;  H  = 


CA*  CB 
VA*  D*B 


Now,  if  we  set  A  =  {I  -  ;5/?+),  B  =  (I  -  M*M) 


C  =  -j{I  -  /3/3+)PQP,  D  =  -JPQP[I  -  M*M] 
then,  from  lemma  1,  we  can  see  that  if  jSk  has  Hermitian  solution 


CA’  =  AC*  ^  [I-  /3/3+]PQPlI  -  S/3+]  =  0  (18) 


D*B  =  B*D  [I  -  M*M]PQP{I  -  M*M)  =  0  . 

Notice  that 

(17)  ^  {I-  M^MTijSkY  =  j{I  -  M+M)PQP 


(16),  (20)=^ 


(/  -  0P+)ijSk)  =  -j{I  -  /30+)PQP 
(/  -  M+M)ijSk)  =  j{I  -  M+M)PQP 


We  require  (16),  (20)  to  possess  common  solutions. 
It  is  obvious  that  (16)  always  has  solution: 


(19) 

(20) 
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{jSk)  =  -jP0PQP-{I-P0)Z  (21) 

Substitute  (21)  into  (20) 

^  -Pmil  -  Pp)Z  =  jPrr.iI  -  P0)PQP  (22) 

(22)  is  solvable  iff 

[I  -  {Pm(3(3+)iPr,.f3/3+)-^]Prr.iI  +  P0)PQP  =  0 
^  [/-(P^/3/3+)(P^;3/?+)+]P„PQP  =  0  (23) 

Hence,  we  have  proved  that  (I4),  (15)  are  equivalent  to  (18),  (19),  (23),  i.e.,  for  to  be  solvable 
iff  (18),  (19),  (23)  hold. 

Q.E.D. 


Appendix  B.  Proof  of  Theorem  2 

We  need  an  extension  of  lemma  1. 

Lemma  2  ^ 

Suppose  the  equation  AX  =  C,  XB  =  D  have  a  common  Hermitian  solution,  the  form  of  the 
solution  is 


Where  U  is  an  arbitrary  Hermitian  matrix  and  [•]“  is  the  generalized  inverse. 

To  generate  all  solutions,  we  must  parameterize  all  pseudo  inverse  [•]“  as  follows 


where  Z  is  arbitrary,  [•]"*"  denotes  the  Moore  Penrose  inverse. 
Now,  if  we  define 


I-0f3+ 

I-M+M 


-{I-M+M) 


PQP 


then  according  to  (24),  (25), 


Sk  =  P+$p  +  (X+ #p)*  -  L+%L+Lp  +  (/  -  P+Xp)5(Z  -  L+Lp) 


(26) 


S  is  an  arbitrary  skew-symmetric  matrix.  Next,  plug  (26)  into  standard  form  of  solution  for  (13), 
we  get:  ' 


Gp  =  -\i3^[PQP  +  L;^p-{L;^py -l;%l;lp]m+ 

~  Pp  Pp)^p{^  ~  Pp  Lp)M'^  +  Zp  —  l3.^l3ZpM M'^ 

where  Zp  is  arbitrary. 

The  parametrization  of  Ga  was  derived  irif . 


Q.E.D. 
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Abstract.  The  Problem  o  finding  the  set  of  all  stabilizing  full-order  controllers  is  equivalent  to  a  problem  of  finding  all  matrices  u  hich 
can  be  assigned  to  the  closed-loop  system  as  a  state  covariance.  The  necessary  and  sufficient  conditions  for  a  given  matnx  to  be 
assignable  as  a  covariance  are  given,  and  all  controllers  lof  plant  order)  which  assign  a  specified  covariance  are  parametrized  explicitlv 
The  structure  of  covariance  controllers  is  shown  for  the  first  time  to  be  observ  er-based  (state  estimator  plus  estimated-state  feedback) 
The  central  state  estimator  of  the  covariance  controller  is  shown  to  be  the  Kalman  filter.  Unlike  the  traditional  estimator-based 
controller,  the  separation  principle  does  not  hold,  but  one  can  design  a  controller  by  assigning  the  estimation  error  covariance  and  the 
plant  state  covariance  simultaneously. 


Keywords:  Covariance  control:  all  stabilizing  controllers;  observer;  Lyapunov  method:  separation  principle. 


1.  Introduction 

In  practical  controller  design  problems,  it  is  frequently  required  to  impose  performance  specifications  on 
the  variances  of  each  output.  Covariance  control  theory  was  originally  motivated  by  such  multiple  design 
objectives:  the  multiple  inequality  constraints  can  be  satisfied  by  assigning  a  matri.x  (which  carries  the 
specified  variance  value  of  each  state  on  the  diagonal)  to  the  closed-loop  system  as  the  state  covariance 
Along  with  the  development  of  covariance  control  theory  [4-9,  11-18]  many  additional  advantages  have 
been  investigated.  Corless  et  al.  [1]  showed  that  the  state  covariance  is  explicitly  related  to  such  disturbance 
robustness  properties  as  the  to  gain  of  the  system,  and  such  stability  robustness  properties  as  an 
upper  bound  on  the  smbilizing  perturbations  in  the  system  matrix,  etc.  Yasuda  et  al.  [17]  showed  that  the 
covariance  controller  is  a  parametrization  of  the  set  of  all  stabilizing  fixed-order  controllers.  It  has  also  been 
shown  [15]  that  covariance  controllers  are  useful  for  designing  reduced-order  controllers. 

In  this  paper,  we  consider  the  covariance  assignment  problem  with  full-order  controllers  (of  order  equal  to 
the  plant)  for  linear  time-invariant  continuous-time  plants.  The  necessary  and  sufficient  conditions  for 
a  matrix  to  be  assignable  as  a  state  covariance  are  obtained  and  explicit  controller  formulas  for  all  full-order 
controllers  which  assign  a  specified  covariance  are  given.  These  new  results  are  obtained  for  the  plant  with 
noisy  measurements  (most  of  the  covariance  control  literature  assumes  noise-free  measurements,  see  [9,  12] 
for  a  few  exceptions).  Based  on  these  results,  the  structure  of  covariance  controllers  is  studied  from  the  point 
of  view  of  estimation  error  covariance  and  plant  state  covariance  assignments.  Design  of  observers  with 
estimation  error  covariance  assignment  was  discussed  in  [18]  and  connected  in  an  ad  hoc  wav  to  an 
estimated-state  feedback  for  controller  design.  Unlike  [18],  the  present  paper  reveals  an  observer-based 
structure  in  the  covariance  controller  without  any  assumptions.  We  shall  show  that  the  separation  principle 
does  not  hold  for  covariance  controllers,  and  that  the  state  estimator  and  the  estimated-state  feedback  ^ain 
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cannot  be  designed  independently.  Nevertheless,  the  estimation  error  covariance  and  the  plant  state 
covariance  to  be  assigned  can  be  specified  subject  to  an  inequality  constraint  on  these  two  covariance  Such 
co„.roller  d.s,8n  m.>hods  ba«d  on  the  oo,a,ia„ce  assignment  are  compn.ationall,  tractaWe  Tnce  an 
assignable  es  imation  error  covananee  can  be  obtained  by  solving  the  LQG.type  Riccati  equatL  and  aS 

organized  as  follows.  Section  2  describes  the  system  models  which  we  will  consider  and  poses 
the  covananee  control  problem.  Section  3  presents  new  assignability  conditions  for  closed-loo/state 
covariance  and  explicit  controller  formulas.  Section  4  introduces  the  concept  of  plant  state  covLance 
ass^nment  ^nd  studies  the  structure  of  covariance  controllers.  Conclusions  are  given  in  Section  5 

transpose  o7^  Mn  ^  expectation  operator.  For  a  matrix  .4  denotes  the 

transpose  of  A.  A  is  the  Moore-Penrose  inverse  of  A.  For  a  nonnegative  definite  matrix  A,  A^  '  denotes  the 

unique  nonnpative  definite  square  root  of  A.  tr[^]  is  the  trace  of  A.  rank  [.4]  is  the  rank  of  A.  SVD  stands 
for  the  singular  value  decomposition. 


2.  The  covariance  control  problem 

We  consider  the  following  linear  time-invariant  continuous-time  system  (Zp): 

^p  =  ^pXp  +  BpW  +  /)pUp,  ^2  1, 

2  =  yV/p.Xp  +  V, 

where  Wp  e  iR  and  v  e  9?"'  are  zero  mean  white  noise  stochastic  processes  with  intensities  W„>0  and  F  >  0 
respectively,  and  correlation  ^[wp(f)(;V)]  =  -  r).  Xp€iR-»  is  the  plant  state,  is  the  control’ 

Tk.  measurement.  Throughout  the  paper,  we  will  assume  that  (A  ,D  )t 

controllable,  (v4p.  Bp)  is  stabilizable,  and  {/Ip,  Mp)  is  detectable.  Consider  a  full-order  dynamic  controller  (Z  J: 

Xp  =  /IpXp  -I-  Bp2,  ^  ^ 

“  =  ^2.4) 

where  x.  e  93"^  is  the  controller  state.  Combining  (ZJ  and  (Zp).  the  closed-loop  system  (Z„)  can  be  described 

x  =  A,tX  +  B,iW, 

where 


It  can  be  shown  that  the  closed-loop  state  covariance 
X:=^[x{t)x(t)T]  =  r5^ 

pc  c 

satisfies  the  following  Lyapunov  equation 
Q  :=  A.^X  A  XAJ,  +  Bp,  WBl  =  0, 
where  W  is  the  noise  intensity  defined  by 


/Ip  +  BpBcMp  BpCp 


Bci-=  P” 

0  B. 


=;  WS(t 


_ri=r 

L«^i"2  F  _ 


S(t  -  t). 


o  J;  ^  is  said  to  be  assignable  as  a  closed-loop  state  covariance  if  it 

satisfies  (2.8)  for  some  controller  (Zc). 
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Since  M  Z)p)  is  controllable,  it  can  easily  be  shown  (see  e.g.  [7])  that  (/1„,  S„)  is  also  controllable  for  anv 
choice  of  (I  )  provided  the  controller  is  minimal,  i.e..  (A„  Cj  is  controllable  and  observable.  Therefore,  by 
Lyapunov  theory,  A„  is  asymptotically  stable  (all  its  eigenvalues  lie  in  the  open  left  half  plane  of  the  complex 
plane)  iff  AT  >  0.  Thus,  by  assigning  only  positive-definite  state  covariances,  closed-loop  stability  is  guaranteed. 

and  conversely,  the  set  of  all  stabilizing  controllers  is  captured,  since  every  stable  system  has  a  finite 
covariance. 

Throughout  the  paper,  we  assume  that  the  plant  state  and  the  controller  state  are  fully  correlated,  i.e., 
A’pc  has  full  rank.  The  assumption  is  not  restrictive,  since  it  is  necessary  to  guarantee  the  ‘minimality’  of  the 
controller  in  the  sense  that  there  is  no  controller  of  smaller  order  which  yields  the  same  plant  state 
covariance,  see  [8]  for  more  general  and  detailed  treatment  of  this  minimality  concept  A  technical 
implication  of  the  assumption  here  is  that  ATp.  is  invertible  since  the  controller  order  is  equal  to  that  of  the 
plant  and  A'p^  is  a  square  invertible  matrix.  Indeed,  it  has  been  shown  in  [3]  that  if  A'p,.  is  not  invertible,  then 
a  controller  smte  variable  can  be  deleted  without  changing  the  closed-loop  plant  covariance. 

Our  objective  is  to  design  a  controller  which  yields  a  specified  matrix  A'  >  0  as  the  closed-loop  state 
covariance.  In  order  to  accomplish  this  objective,  we  pose  the  following  questions: 

(i)  What  are  the  necessary  and  sufficient  conditions  for  assignability? 

(ii)  What  are  the  controllers  which  assign  a  given  assignable  covariance? 

Answers  to  questions  (i)  and  (ii)  are  given  in  the  next  section. 


3.  Assignability  conditions  and  controller  formulas 

The  following  theorem  yields  necessary  and  sufficient  conditions  for  a  positive-definite  matrix  to  be 
assignable  as  the  closed-loop  state  covariance  and  gives  explicit  formulas  for  all  (full-order)  controllers  (I  ) 
which  assign  a  given  state  covariance  X  >  0.  ' 


Theorem  3.1,  Let  a  positive-definite  matrix  A’ e he  given.  Then  X  is  assignable  as  a  closed-loop  state 
covariance  iff  it  satisfies 


(/  -  b^b;  ){a,x,  x,Aj  +  Op  -  b,b;)  =  o, 

^  ~  ~  ■^p-^p  —  XpAj  —  Dp  iVpDp  H-  (XpMp  +  Dp  IT, 2)  V~^(XpMp  +  Dp  IT,2)^  >  0, 

rank(J?)  <  n^, 
where 

Xp-.=  Xp-Xp^X-^Xlp. 

If  these  conditions  hold^  all  controllers  which  assign  X  are  given  by 

A,  =  X,Xp-^{Ap  +  BpD.Mp  -I-  LpV^  ^-BjX;,^)Xp,X:^  -  B^MpXp.X^^  +  A'.ATpi'BpC,, 
^c  —  X^Xpi-  [_{XpMp  +  DplVi2)V  * -I- BpOj  —  Z.p  T  ~ 

Cc  =  tB*(Qp  -k  BpD,  FOJSJ  +  BpDSj  +  TpDjBDill  -  BpB;)Xp-J 

+  b;  sBpB;  Xp-j  +  (i-  b;  Bp)z, 

Dc  =  arbitrary, 

where  Z  is  arbitrary  and  S  is  an  arbitrary  skew-symmetric  matrix  and 
R:=  LpLl, 

Qp  :=  ApXp  -h  XpAl  -f  OpITpOj,  rp:=  XpMj  +  Op  IT, 2. 


(3.1) 

(3.2) 

(3.3) 

(3.4) 

(3.5) 

(3.6) 

(3.7) 

(3.8) 

(3.9) 
(3.10) 
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Proof.  Computing  each  partitioned  block  of  Q  defined  by  (2.8),  we  have 

Qii  ■■=  Qp  +  B^D.VDJb;  +  BpD.rJ  +  fpDjBj  +  BpC.Xjp  +  XppCjBj  =  0.  (3.1 1) 

Qi2;=  {A^  +  +  X^,Aj  +  (Bp  +  B^D,V)Bj  +  B^C.X,  =  0,  (3.12) 

Q22  :=  A,X,  +  X,Aj  +  B.MpXpc  +  X Jc  Wj Bj  +  B,  FB,  =  0,  (3. 13) 

where  Qp  and  fp  are  defined  by  (3.10). 

Necessity:  Suppose  a  given  matrix  X  >  0  is  assignable  as  a  state  covariance.  Then  there  exists  a  controller 
(Xc,Bc,Cc,Bj)  satisfying  (3.11)-(3.13).  Pre-  and  post-multiplying  (3.11)  by  (f  —  BpBp  )  immediately  yields 


(3.1).  Let 

B.;=[/  -2fppXr‘],  Q:=P.QPJ.  (3.14) 

Using  (3.11)-(3.13),  (3.14)  yields 

Q  =  Qp  +  (BpZ)p  -  .Ypc  Jp-  ‘)f  J  +  fp(BpD,  -  Yp,Y,-  ‘  B,)^ 

+  (BpZ),  -  Yp,Y;  ‘  Bp)  K(BpDp  -  YppY^'  ‘Bc)^  =  0  (3.15) 

where 

Qp:=/lpYp  + Yp/lJ  +  BpfFpBj,  r^:=  X^Ml  +  D^iV,2.  (3.16) 

Completing  the  square,  (3.15)  is  equivalent  to 

Qp  fpK-'fp-'^  -h  LpLj  =  0,  (3.17) 

where 

Lp:=  (5pD,  -  ^  B,  +  fp  M  (3.18) 


Since  LpLj  >  0  and  rank  (IpLj)  <  (3.17)  shows  that  the  conditions  (3.2)  and  (3.3)  are  necessary. 

Sufficiency:  Suppose  the  assignability  conditions  (3.1)~(3.3)  are  satisfied  for  a  matrix  X  >  0.  Sufficiency 
will  be  shown  by  constructing  all  controller  matrices  satisfying  (3.11)“(3.13). 

Lemma  3.1  (Skelton  and  Ikeda  [1 1]).  Let  matrices  A,  B,X  and  Q  be  given  where  X  is  invertible  and  Q  =  Q^. 
Then  there  exists  a  matrix  G  such  that 

BGX  +  (BGX)^ -h  Q  =  0,  (3.19) 

iff 

(I  -  -  BB^)  =  0  (3.20) 

holds,  in  which  case,  all  such  matrices  G  are  given  by 

G  =  -^B^Q{2I  -  BB^)X^^  +  B^SBB^X-^  A- {I  -  B^  B)Z,  (3.21) 

where  Z  is  arbitrary  and  S  is  an  arbitrary  skew-symmetric  matrix. 

Applying  Lemma  3.1  to  equation  (3.11),  the  existence  of  Cc  satisfying  Qn  =  0  is  guaranteed  (for  any  choice 
of  Dc)  by  (3.1)  and  invertibility  of  Xpc,  and  all  such  matrices  Cc  are  given  by 

Cc  =  i  B;  (Qp  +  B^D,  VDJ Bj  +  B,D,rJ  +  r,DjBl)(2I  -  BpBp*  )Yp-^ 

+  b;  sBpBp*  Yp-pT  +  (/  -  b;  b^)z,  (3.22) 
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where  Z  is  arbitrary  and  S  is  an  arbitrary  skew-symmetric  matrix.  Now,  instead  of  solving  (3.12)  and  (3.13) 
we  consider  the  following  equivalent  equation;  ' 


1^22  J 


The  first  row  block  of  (3.23)  gives 


^  pc 


(3.23) 

'^BJ  =  0. 

(3.24) 

+  ^V,2fp;‘BpC,. 

(3.25) 

Solving  for  A^,  we  have 


Finally,  we  need  to  show  the  existence  of  and  D,  satisfying  the  second  row  block  of  (3.23),  or  Q,,  =  0  with 
;4  and  C.  given  by  (3.25)  and  (3.22),  respectively.  Recall  that,  if  any  solution  B,  exists,  then  it  m'ust  satisfy 
(3.18)  for  some  where  satisfies  (3.17).  Solving  (3.18)  for  ^ 


B,  =  x,x-^(r,v 


+  BpZ)p-LpK-‘2). 


(3.26) 


Now  we  claim  that,  gi^n  any  matrix  the  controller  matrices  /!„  B,  and  C,  given  by  (3.25),  (3.26)  and 

(3.22)  satisfy  Q22  -  0.  This  can  be  verified  as  follows.  Substituting  A,  and  B^  into  (3.13),  then  using  (3  1 1)  to 
eliminate  Cc,  we  have 


Q22  =  -  x,x-UQ,  -  r,v-^r;^  +  l,lI)x;:^x^  =  o. 
where  the  last  equality  holds  due  to  (3.17).  □ 


(3.27) 


Theorem  3.1  provides  an  easy  way  to  check  if  a  specified  matrix  A'  >  0  is  assignable  as  a  state  covariance. 
However,  a  desirable  state  covariance  (determined  by  design  specifications)  is  not  assignable  in  most  cases. 
Hence,  we  need  a  method  to  construct  an  assignable  covariance.  The  following  corollary  gives  an  alternative 
charactenzation  of  the  set  of  all  assignable  state  covariances,  which  is  useful  for  constructing  an  assignable 
covanance.  Hereafter,  we  will  assume  that  there  is  no  correlation  between  the  process  noise  w  and  the 
measurement  noise  v,  i.e.,  =  0  for  simplicity. 


Corollary  3.1.  Let  Xp  and  Xp  be  any  matrices  satisfying 

(I  -  BpB^HApXp  +  XpAj  +  Dp  iVpDlHI  -  BpBf)  =  0, 

ApXp  +  XpAj  -  XpMj  y- ‘  MpXp  +  Dp  IVpDj  +  LpLj  =  0, 

0<Xp<Xp 

for  some  Z,pe91"p  Then  the  set  of  all  assignable  covariances  can  be  generated  by 

r  ^fp  Nrn 

Itn'^ 

where  T  is  any  nonsingular  matrix  and 
(Xp-Xpff 


(3.28) 

(3.29) 

(3.30) 

(3.31) 

(3.32) 


Proof.  Noting  that  (3.2)  and  (3.3)  hold  iff  B  =  IpLj  for  some 


■  '  -p-p  - — p--.  ,  we  see  that  any  assignable 

^variance  X  mu«  satisfy  (3.28)  and  (3.29)  for  some  Lp.  It  is  necessary  that  jp  >  0  since  A"  >  0,  and 

P*  ^  ®  ‘s  a  square  invertible  matrix.  This  proves  the  necessity  of 

(3.28)  (3.30).  Sufficiency  can  easily  be  verified  by  noting  that  NT^  =  Xp^  and  TT^  =  A’  .  □ 
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The  above  results  are  useful^  for  construction  of  assignable  state  covariances  since  (3.28)  and  (3.29)  are 
uncoupled  in  terms  of  and  Xp,  and  hence  and  .?p  can  be  obtained  by  solving  the  linear  equation  (3.28) 
for  Xp  >  0  and  the  standard  Riccati  equation  (3.29)  for  Xp  >  0.  However,  we  must  still  check  if  X  >  X  as 
in  (3.30).  " 

When  constructing  an  assignable  state  covariance  as  in  (3.31)  for  given  Xp  and  Xp  satisfying  (3.28)-(3.30), 
we  have  a  freedom  in  choosing  a  nonsingular  matrix  T.  However,  this  freedom  does  not  affect  the  closed-loop 
performance  since  the  matrix  Tcon^ibutes  only  to  the  similarity  transformation  on  the  controller  coordi¬ 
nate.  Thus,  the  matrices  Xp  and  Xp  are  the  only  factors  that  determine  the  closed-loop  performance 
embedded  in  the  state  covariance  X.  In  view  of  the  controller  formula  (3.5)-(3.8),  the  other  freedoms  for  the 
closed-loop  performance  are  the  direct  measurement  feed  through  gain  and  the  arbitrary  matrix  Z  and  the 
arbitrary  skew-symmetric  matrix  S.  The  freedom  Z  disappears  if  there  is  no  redundant  actuators,  i.e.. 

®p  >  0,  since  in  this  case  /  —  B*  Bp  =  0.  The  skew-symmetric  freedom  S  can  be  utilized  for  minimization 
of  the  input  energy  by  the  similar  method  to  that  of  [13], 


4.  The  structure  of  covariance  controllers 

In  this  section,  the  structure  of  covariance  controllers  is  studied.  It  will  be  shown  that  the  full-order  strictly 
proper  covariance  controller  can  be  interpreted  as  an  observer-based  controller,  i.e.,  a  state  estimator  plus  an 
estimated-state  feedback.  To  this  end,  we  restrict  our  attention  to  strictly  proper  controllers  and  hence  to 
a  special  choice  of  the  arbitrary  Dp  in  Theorem  3.1  (Dp  =  0). 

As  has  been  shown  in  Corollary  3.1,  the  controller  state  covariance  Xp  and  the  correlation  Xpc  are 
controller-coordinate-dependent.  Moreover,  in  general,  the  description  of  output  performance  specifications, 
such  as  the  variances  of  each  output,  does  not  require  the  whole  closed-loop  state  covariance  X  but  only  the 
plant  state  covariance  Xp.  Hence,  assigning  a  matrix  Xp  as  the  plant  state  covariance  makes  more  sense  than 
the  closed-loop  state  covariance.  This  motivates  the  plant  state  covariance  assignment  problem,  defined  as 
follows. 

Definition  2.  A  positive-definite  matrix  XpS  is  said  to  be  assignable  as  a  plant  state  covariance  if  there 

exists  a  controller  which  yields  ^[Xp(t)Xp(t)'^]  =  Xp. 

As  in  the  case  of  the  closed-loop  state  covariance  assignment  problem,  the  solution  to  the  plant  state 
covariance  assignment  problem  consists  of  (1)  necessary  and  sufficient  conditions  for  a  matrix  Xp  to  be 
assignable  as  a  plant  state  covariance,  and  (2)  an  explicit  formula  for  all  controllers  which  assign  a  specified 
plant  covariance.  The  following  theorem  gives  not  only  the  solution  but  also  a  transparent  description  of  the 
covariance  controller  structure. 

Theorem  4.1.  Let  a  positive-definite  matrix  XpSiR"'’’'"'’  be  given.  Then  Xp  is  assignable  as  a  plant  state 


covariance  iff  it  satisfies 

(/  -  BpB;){ApXp  -i-  XpAj  +  DpWpDjm  -  BpB;)  =  0,  (4.1) 

Xp  >  P,  (4  2) 

where  P  is  the  unique  positive-definite  solution  to  the  following  standard  Riccati  equation: 

ApP  +  PAJ  -  PMl  y-^MpP  +  Dp  fVpDj  =  0,  (4.3) 

in  which  case,  all  strictly  proper  full-order  controllers  which  assign  Xp  are  given  by 

Ap  =  Ap-  Bp  Mp  +  BpCp  +  LpV^'^  Bj  Xf  ‘ ,  (4.4) 

Be  =  XpMJk’-■-LpK-‘'^  (4.5) 


=  -  T  V +  DpWpDl)(2I  -  BpBp^)X,-‘  -t-  BfSBpBfXp-^  -b  (/  -  B;Bp)Z,  (4.6) 
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where  Z  is  arbhrery  and  S  is  an  arbitrary  skew-symmetric  matrix  and  k,eSI . Is  any  matrix  such  that 

where  Xp  is  the  unique  positive-definite  solution  Xp>0  of 

A,X,  +  X,Al-  X,M;v-^M,X,  +  Dp  PTpDj  +  =  0,  ,4.8) 

^‘osed-loop  state 


-=P'> 

jc  X,- 


n  r  ”  ^  covariance.  Then  from  Corollary  3.1,  ATp  must  satisfy 

nrnnlrtv^  monOtOnicity 

property  of  the  solution  to  the  Riccati  equation  (see  e.g.  [10]),  the  stabilizing  solution  X,  satisfies 

0<  P^Xm 

"  (4.10) 

for  any  choice  of  where  P  is  the  stabilizing  solution  for  the  case  =  0.  This  proves  the  necessity  To 

^  ®  a  '"atrix  X,  >  0  satisfying  (3  ^9) 

and  (3.30)  for  some  (small  enough)  Dp,  which  can  be  verified  by  a  choice  Dp  =  0.  Hence,  we  can  construct  an 
assignable  closed-loop  state  covariance  X  as  in  (3.31)  and  compute  the  controller  matrices  using  (3.5)-(3  8) 
where  we  choose  D  -  0  since  only  the  strictly  proper  controller  is  of  interest  here.  This  proves  the  sufficiency’ 

Finally,  the  controller  formula  (4.4)-(4.6)  can  be  obtained  by  choosing  the  controller-coordinate  transforma¬ 
tion  matrix  T  in  (3.31)  to  be  N,  defined  by  (3.32).  □  ‘Murma 

Note  that  the  set  of  all  assignable  plant  state  covariances  is  convex  as  the  intersection  of  the  linear  affine  set 
defined  by  (4.1)  and  the  convex  cone  defined  by  (4.2).  Thus,  the  controller  design  based  on  the  plant  state 
covanance  assignment  is  computationally  tractable  (see  [4]). 

To  interpret  Theorem  4.1  in  terms  of  the  concept  of  observer-based  controllers,  we  refer  to  the  following 
feedback"[5^nT^^  estimation  with  error  covariance  assignment  [18]  and  the  covariance  control  with  state 

Theorem  4.2  (Yaz  and  Skelton  [18]).  Given  a  linear  time-invariant  continuous-time  plant  {I A,  consider  the 
following  state  estimator  (T„):  r  y  p„ 

ip  =  ^p;ep  -I-  BpU  -(-  F(z  -  MpXp),  j 

where  the  estimator  gain  F  is  the  only  design  parameter.  There  exists  a  state  estimator  (D„)  which  assigns 
a  given  matrix  E  >  0  as  the  estimation  error  covariance^  i.e,, 

^  ~  ~  ^p)(-^p  ~  -^p)^],  (4.12) 

iff  E  satisfies  the  Riccati  equation 

A^E  -I-  EAl  -  fMj  F-iAfp£  -|-  Dp  fFpDj  +  DpDj  =  0  (4  13) 

for  some  DpSlR"'’’'"*,  in  which  case,  all  estimator  gains  which  yield  (4.12)  are  given  by 

F  =  EMlV-^-L,V-^>\  (4.14) 

Theorem  4J  (Hotz  and  Skelton  [5]  and  Skelton  and  Ikeda  [1 1]).  Consider  a  linear  time-invariant  continuous¬ 
time  plant  (I  A  positive-definite  matrix  JTp  >  0  is  assignable  as  a  state  covariance  via  state  feedback  control 
law  u  =  Gxj,  iff  Yp  satisfies 

(1  -  Bf,Bp){ApXj,  -i-  XpAl  4-  DpfFpDj)(/  -  B^B^)-  0,  <4  151 
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and  the  set  of  all  state  feedback  gains  G  which  assign  is  given  by 

G  =  +  A^X^  +  DpH^pZ)J)(2/  -  B^B;)Xf^  +  BfSB^BfX;^  +  (/  -  Bf  B^)Z.  (4.16) 

where  Z  is  arbitrary  and  S  is  an  arbitrary  skew-symmetric  matrix. 

dJcn'bJn  h!  7  feedback  structure  of  the  full-order  covariance  controller 

descnbed  by  Theorem  4.1  is  evident  by  companng  (4.5)  with  (4.14)  and  (4.6)  with  (4.16).  We  will  discuss  the 
structure  for  the  state  estimator  part  and  the  estimated-state  feedback  part  separately 
First  consider  the  state  estimator  part.  Note  that  the  set  of  all  B,  (with  freedom  L,)  given  by  (4  5)  and  (4  8) 

iam  f  isa^d ““  ’"“73)  where  an  eetimaror 

gain  t  is  said  to  be  admissible  if  it  yields  a  finite  error  covariance.  Comparing  (4.8)  with  (4.13)  we  can  attach 

significance  to  Xp  (which  has  been  defined  as  the  Schur  complement  ofX  in  (3.4))  as’the  estimation 

error  covanance.  In  fact,  using  (4.7)  and  (4.9),  uiccsumauon 

-  Xj(.Xp  -  .XJT]  =  ^[.XpXj]  -  ^[.xp.xj]  -  <?[.x,xj]  +  <?[.x,x7] 

~  Xc  +  X^  =  Xp. 

Also  note  that,  from  (4.4),  (2.3),  and  (2.4) 

X,  =  ApX,  +  Bpu  +  B,(z  -  Mpxj  +  Bp  ^ BjXf^Xp  (417) 

which  has  an  extra  term  due  to  Lp  (the  last  term)  when  compared  with  (4.1 1).  If  we  call  the  estimator  part  of 
the  covanance  controller  obtained  by  choosing  Bp  =  0  the  ‘central  estimator’,  it  is  apparent  that  the  antral 
estimator  is  the  Kalman  filter.  Since  P  >  0  given  by  (4.3)  satisfies  P  ^  Xp  for  any  choice  of  Bp,  the  Kalman 
filter  optimizes  not  only  the  scalar  objective  tr(A'p)  as  m  the  standard  LQG  theory  but  also  the  matrix- 

Ifihl  ^  ^  ‘^‘her  hand,  nonzero  choices 

I  ^  ‘f"  other  performances.  For  instance,  it  has  been  shown  [2]  that  the 

central  estimator  has  the  following  structure; 

Xe  =  >lpX.  +  BpU  -I-  Bp(z  -  MpXj  -t-  Dpvv„p„,,  (4  jg) 

where  w  ,  can  be  thought  of  loosely  as  an  estimate  for  the  worst-case  disturbance  in  the  sense  of  the  JlT 
norm.  This  illustrates  the  importance  of  an  extra  term  as  in  (4.17).  However,  how  to  choose  Bp  to  accomplish 
various  objectives  remains  an  open  issue.  ^  ^ 

u  estimated-state  feedback  part  of  the  covariance  controller,  we  see  that  the  feedback  gain  C  given 

by  (4.6)  ,s  ,dem,yal  ,o  C  iM4.16)  if  w.  replace  by  if,.  This  differanc.  car  be  interprets  af  th^ 
compensation  for  the  estimation  error  due  to  noisy  measurements  by  subtracting  the  error  covariance  X„ 
rom  X  to  obtain  A’p.  Also  note  that  the  set  of  all  assignable  plant  state  covariances  with  full-order 
controllers  IS  a  subset  of  that  with  state  feedback  with  the  additional  constraint  P  <  Xp.  This  fact  makes 
sense  physically  since  the  estimation  error  covariance  P  is  zero  if  all  the  states  are  available  without  noise 
(r  IS  the  smallest  achievable  estimation  error  covariance). 

Finally,  we  see  that  the  separation  principle  does  not  hold  for  the  covariance  controller,  i.e.,  the  state 
estimator  and  the  estimated-state  feedback  gain  cannot  be  designed  separately  since  the  determination  of  the 
estimator  parameters  A,  and  B.  involves  closed-loop  information  Xp,  and  the  computation  of  the  estimated- 
state  feedback  gam  Ce  requires  the  estimator  information  Xp.  Nevertheless,  the  plant  state  covariance  Xp  to 
be  assigned  can  be  specified  without  any  knowledge  of  the  estimator  since  the  characterizations  of  ATp  given 

ihl  fd  f  ^  ^  of  assignable  Xp 

(by  (4.1),  (4.2)),  there  always  exists  a  full-order  controller  to  assign  Xp  to  the  closed-loop  system. 
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5.  Conclusion 


ment  noise  IncluLon  of  the  t.me-mvanant  continuous-time  systems  with  measure- 

assignability  condition.  Parametrizing  the  set  oTall  taWh^rnl^nf 
covariances,  the  design  of  linearco^ohers  reduc 

carries  desirable  closed-loop  properties.  ^  assignable  state  covariance  which 

wU?rp"e^"s  ■»  co„,panso„ 

covariance  controller)  It  has  been  shown  that  th  ^  covariance  assignment  and  the  state  feedback 

hold,  ..e.,  the  state  LLator  cantr  bi  TT"'  T"? "ot 
However,  simultaneous  assignment  of  the  ettiSn  estimated-state  feedback  gain, 

easily  be  done  by  solving  a  Riccati  equation  with  a  f  and  the  plant  state  covariance  can 

covariance,  and  by  searching  for  an  assignable  nUnt"!:t  °  ‘^intension  for  the  estimation  error 
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Minimal  energy  covariance  control 

R.  E.  SKELTONt.  JI-HAN  XU-i-  and  KAZUNORI  YASUDAt 

In  general,  the  covariance  controller  which  assigns  a  specified  state  covariance 
X  to  the  system  is  not  unique,  and  the  whole' set  of  such  controllers  can  be 
parametrized  by  a  skew-symmetric  matrix  S  of  appropriate  dimension.  This 
paper  descnbes  how  to  minimize  the  control  energy  by  using  this  freedom  and 
reveals  some  properties  of  closed-loop  system  poles  with  respect  to  5. 


1.  Introduction 

The  main  idea  of  the  covariance  control  theory  developed  by  Hotz  and 
Skelton  (1987)  and  Skelton  and  Ikeda  (1989)  is  to  choose  a  state  covariance  X 
according  to  different  requirements  on  the  system  performance  and  robustness 
and  then  to  design  a  controller  so  that  the  specified  state  covariance  is  assigned 
to  the  closed-loop  system.  For  example,  a  performance  requirement  might  be 
constraints  on  the  output  variances: 

n  =  [cxah  «  a,,  f  =  1 . n, 

where  [•],,  stands  for  the  fth  diagonal  element  of  the  matrix.  Stability  robustness 
might  require  constraints  on  the  maximum  singular  value  of  X  and  Y  (Corless  et 
al.  1989).  The  computational  errors  in  analogue  controllers  (from  amplifier 
noise)  can  be  minimized  by  placing  constraints  on  the  controller  state  covariance 
Xq- 


-Tpc 

and  5  is  a  constant  scaling  factor  (Hwang  1977,  Liu,  1991). 

In  general,  the  controller  which  assigns  the  given  X  to  the  system  is  not 
unique,  and  the  whole  set  of  such  assigning  controllers  can  be  parametrized  by  a 
skew-symmetric  matrix  S  =  -5*  of  appropriate  dimension.  Also,  the  system 
properties  cannot  be  decided  solely  by  the  state  covariance  X.  This  paper 
describes  how  to  use  these  free  parameters  to  minimize  the  control  energy  and 
reveals  some  properties  of  the  closed-loop  system  poles  with  respect  to  S. 

The  paper  is  outlined  as  follows.  A  brief  review  of  the  covariance  assignment 
problem  based  on  the  result  by  Yasuda  and  Skelton  (1990)  is  given  in  §  2.  In 
§3,  the  free  parameter  S  = —S*  for  parametrizing  the  set  of  covariance 
controllers  is  used  to  minimize  the  mean  squared  control.  Some  properties  of 


where  X^  is  the  (2,  2)  block  of 


X  = 


Y* 

.  pc 
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the  closed-loop  system  poles  with  respect  to  the  free  parameter  5.  which  can 
help  to  choose  a  specific  5  when  considering  also  the  location  of  the  closed-loop 
system  poles,  are  described  in  §  4.  To  illustrate  the  theory  we  give  an  example  in 
§5.  Finally  the  paper  is  concluded  with  §6  where  the  further  research  in  this 
direction  is  discussed. 


2.  Parametrization  of  covariance  controllers 

Consider  the  following  linear  system  of  order 


Xry  =  -I-  B„U  +  Dr.  w 

J  (2.1) 

z  =  A/p.Vp  J 

where  .Vp  e  R”'  is  the  state,  u  €  R”"  the  input,  w  e  R"*  the  plant  disturbance, 
and  j  e  R"-  the  measurement.  This  system  is  driven  by  a  linear  controller  of 
order  n^: 


By  defining  the  matrices 


ic  =  ^c-^c  +  B^z 
u  =  C^Xc  +  D^z 


(2.2) 


A  i 
G  k 


0 

0_ 

Q 


(2.3) 


where  denotes  an  n,,  x  identity  matrix,  the  closed-loop  system  can  be 
written  in  the  following  form; 


X  =  {A  +  BGM)x  +  Dw  (2.4) 

The  state  D  covariance  X  of  the  system  (2.4)  (D  for  deterministic)  (Yasuda  and 
Skelton  1990)  is  defined  by 

r  -x 

^  =  2  I  '^('’  Odf,  r  = 

<=r° 


where  x{i,  t)  denotes  the  state  response  of  the  system  (2.4)  when  only  the  ith 
excitation  is  applied  (from  the  total  of  n,  +  nc  +  excitations;  J:pj0),  Xc/0). 
Wy(t)  =  Wy6{t),  or  =  1,  .  .  .,  n^,  P  =  I,  .  .  .,  y  =  1,  .  .  ..  /r,,.).  It  is  known 
(Yasuda  and  Skelton  1990)  that  X  is  the  unique  solution  of  the  Lyapunov 
equation 


(A  -H  BGM)X  +  X{A  -H  BGM)*  +  DoDgl  =  0  (2.5) 

if  the  closed-loop  system  A  -t-  BGM  is  stable,  where 

DoDo*  i  DWD*  +  Yo,  Yg  =  diag[.  .  .  xl^{0)  .  .  .  ;c;^(0)  .  .  .] 

W  =  diag [.  .  .  Wy  .  .  .] 
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Hence,  the  D  covariance  assignment  problem  is  to  find  G  such  that  (2.5)  is 
satisfied  for  a  specified  X  >Q.  In  this  case,  the  stability  of  the  closed-loop 
system  is  assured  if  {A  +  BGM.  Do)  is  controllable,  which  is  always  true 
because  Dq  is  a  non-singular  matrix.  The  existence  conditions  for  a  controller  of 
order  n^  which  will  assign  X  to  the  closed-loop  system  are  given  as  follows 
(Yasuda  and  Skelton  1990). 


Theorem 2.1  (Yasuda  and  Skelton  1990):  A  specified  X>0  can  be  assigned  to 
the  system  by  G  if  and  only  if 


(I  -  Bp5;)Qp(/ -  Sp^;)  =0  (2.6) 

(I  -  M;M^)Q^{I  -  Mp^V/p)  =  0  (2.7) 

{I  -  LL^){I  -  M^M)X-^QBB*  =0  (2.8) 

are  satisfied,  where  the  superscript  plus  (-)-)  denotes  the  Moore- Penrose  inverse 
and 

Qp  4  XpA;  +  ApXp  +  DpoD^ 

Qp  4  x;\XpA;  +  ApXp  +  DpoD^io  x^x;^XocX;^x;,)x;^ 

Yp  4  Yp  -  Yp,y;‘y;,  (>0) 

L  k{I  -  M* M)X-'^BB* 

Q  4  XA*  +  AX  DqDJ 
Do*  4  [D^b^^Jb] 

For  the  characterization  of  all  controllers  which  can  assign  X  to  the  system 
we  have  the  following  theorem  (Yasuda  and  Skelton  1990). 


Theorem  2.2  (Yasuda  and  Skelton  1990):  Suppose  that  X  is  assignable;  then  all 
controllers  which  assign  X  as  a  state  covariance  to  the  system  (2.4)  are  given  as 
follows: 

G  =  G^  +  G2SG3  +  Z  -  B*BZMM*  (2.10) 

where  S  is  a  skew-symmetric  matrix  and  Z  an  arbitrary  matrix  of  appropriate 
dimension  respectively,  and 


Gi  4  -\b*Q{2I  -  SS*)Y"‘M*  -H  -  'V)BB*X-'^M^ 

Gi  4  S+(/  -  L  +  L) 

G3  4  (/  -  L* L)BB*X-^M* 


with 


W  4  2L*{I  -  M^M)X-^Q  +  [/  -  L*(l  -  M* M)X-^]QL^  L 
Remark  2.1:  By  using  the  singular  value  decomposition  of  L  given  by 


L  = 


'Un 

G21 


^12 

G22J  L  0 


Vfi 

vti 


Vt2 


*  ~1 
21 

I2J 


and  defining 


= r 

L'^22j 


(2.11) 

(2.12) 

(2.13) 
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the  dimension  of  the  skew-symmetric  matrix  in  (2.10)  can  be  reduced,  which 
means  an  elimination  of  the  redundant  'free  parameters’.  In  this  case  we  have 

G  =  Gi  +  G.SGj  +  Z  -  (2.14) 

where  Gj  and  Z  are  defined  as  before: 

G:  =  B*Vt  (2.15) 

G3  =  V.BB^X-^M*  (2.16) 

and  S  is  any  skew-symmetric  matrix  of  appropriate  dimension  which  is  obviously 
less  than  that  of  5  in  (2.10). 

We  shall  assume  that  Bp  has  full  column  rank  and  Mp  full  row  rank.  In  this 
case. 

B*BZMM^-Z  =  0  (2.17) 

and  the  set  of  all  covariance  controllers  assigning  X  to  the  system  is  para¬ 
metrized  by  S  =  -S*.  This  freedom  will  be  used  in  the  following  sections  for 
improving  some  other  system  performances.  □ 


3.  Minimization  of  control  energy 
The  cost  function 


=  i t)dt 


is  often  used  as  a  measure  for  control  energy  in  design.  By  using  the  relation 

U  =  Cc^c 

r  1 

=  [D,Mp  Q] 

the  function  (3.1)  can  be  rewritten  in  the  following  way: 

u  =  tT{UR)  {2 

where 


G  =  2  f  u(i,  t)u’*(i,  t)dt 


[D,Mp  C,]X[D,Mp  Q 


=  [D,Mp  Q 


^pc 


M*D* 

C? 


with  X  being  the  state  D  covariance  of  the  system.  Hence, 

V  =  tr{D,MpXpM*D*R  +  D.MpXp^CtR  +  C,X^MID*R  +  C^X,C*R) 


(3.4) 

It  is  obvious  that  for  the  given  Mp  and  R  the  value  of  o  depends  not  only  on  the 
D  covariance  X  but  also  on  and  Q  which  in  turn  are  the  functions  of  S  for 
the  given  X  as  explained  in  §  2.  In  the  rest  of  this  section  we  shall  describe  how 
to  minimize  v  with  respect  to  5;  that  is.  among  all  the  controllers  which  assign  a 
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specified  X  to  the  system,  we  shall  determine  that  which  consumes  the  least 
energy. 

A  basis  for  all  skew-symmetric  matrices  5  =  -5*  e  can  be  chosen  as 

follows: 

To.  ...  0  ...  o1 


0  -U;  O, 


0  ,  for 


7  =  1 . n, 

k  =  1.  .  .  .,  rij  but  k  ^  j 


where  1,*.  means  that  the  (;.  k)  entry  of  the  matrix  is  1.  Since  the  number  of 
different  5,*  is  m  =  -  1),  we  can  rename  the  set  {5y*.}  as  {5,}  with  /  =  1, 

. .  .,  m.  With  this  basis,  the  set  of  all  skew-symmetric  matrices  can  be 
parametrized  with  {or,,  /  =  1 . m}  as  follows: 

5  =  ofiSi  -h  •  •  •  -I-  a„S„  (3.6) 

Correspondingly.,  the  covariance  controller  has  the  following  form: 


C, 

Br  A 


=  Gi  +  G25G3  =  Gi  -h 
■J  /=i 


By  blocking  the  matrices  Gj  and  G25/G3  in  the  same  way  as  that  of  blocking  G 


^cO  Gco 
BcO  ^cO 


G^S.Gt  = 


^ci  Gcj 

Bci  A, 


we  have 


rri  m 

-I-  Dq  =  ^  <XiDci  (.'.9) 

(=1  1=1 

Substituting  and  in  (3.4)  with  those  in  (3.9),  we  have 

ir{D,M^X,MlD*R)  =  tr  (DcoMpZpA/*D2b/?)  +  2^^,  tr(D,,oMpZpMp*D,-,/?) 


where 


+  22a',»;tr(Dc/Mp.VpM*D*y/?) 

1=1/= 1 

Cl  +  Zor^hi  +  a^Qi(x 


ci^  =  [ai - -  a„] 

Cl  =  tTiDaMpXpM*D!^R)  e 

r  triD^MpXpM^DtiR)' 


tr(D^MpXpM^D*^R)_\ 

\T(D,iMpXpM;D*iR)  .  .  .  tr(D,iMpZpMp*D*„7?) 


lr(D,„MpXpM*pD',,R) 


\.x{D,rr,MpXpM;Dt„,R) 


=  Q*  g 


(3.i0) 


(3.11) 

(3.12) 


(3.13) 


(3.14) 
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lx(D,M^X^,CtR)  =  tr(D^,3.V/p^pcCco/?)  + 


where 


where 


+  Var,tr(Dc,A/pA'pcC3)i?)  +  '^'^a,cXi\.x(D^,M^X^Ct;R) 

1=1  i=i/=i 


=  c;  -  (x*bi  +  a*Qia 


c.  =  tr(D^).V/p^pcC5)/?) 


lx(D^,,M^X^CtxR)  +  lx{D,,M^X^C%R) 
tr(D..).V/pZpcC?;„«)  +  Xx{D,„M.XMR) 


tr(D,,.V/p^C?iR) 

ix{D„„M.XMR) 


ix(D,,M^X,,Q:.R) 

ix{D,„M.X^C*„,R) 


xx(C,X%MtD*R)  =  C3  +  a*bi  +  (x*Q:.a 


cy  —  ct,  ^3  —  b2,  Qi  —  Q* 


(3.15) 


(3.16) 


(3.17) 


(3.18) 


(3.19) 


(3.20) 


tx{C,X,QR)  =  tx(C^X,C^R)  +  2^aXx{CaX,C*iR) 


where 


+  ^lai^iinCaX^CtiR) 

/=1/=1 

=  C4  +  2^*64  +  a*Q4a 


C4  =  tr(CcoA'cC^/?) 

"tr(Cco;^cCc*i/?) 
z>4  =  ; 

jxiCaX,C*„R) 

rtxiQ,X,C*^R) 


tx(C,„,X,C*,R) 


tr(Q,A'cC*„,/?) 

tx{C,„,X,C*„,R) 


Hence,  we  have 


where 


t,  =  2  u*{i.  t)Ru{i,  /)df 


=  c  +  2a*b  +  a*Qa 


C  =  Cl  +  Ct  +  C3  +  C4 

b  ~  b^  ^  \b'>  ^b'\  b^ 


(3.21) 


(3.22) 


(3.23) 


G  =  01  +  02  +  2.1  +  04 
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Since  y  ^  0  is  quadratic  in  a  we  have  Q  =  Further  we  can  draw  the 

following  conclusion. 

Theorem  3.1:  For  a  specified  state  covariance  X.  the  cost  function 

y  =  2]  I  t)dr 

/=r'’ 

=  c  +  lab  +  a*Qa 

where  c.  b  and  Q  are  previously  defined  by  (3.23).  has  a  global  minimum  with 
respect  to  a.  if  and  only  if  (I  —  QQ'*')b  =  0.  and  the  minimum  can  be  achieved 
by  any  a  satisfying 

Qa  +  b  =  0  (3.24) 

Proof:  The  proof  follows  from  5v/oa  =  2b  +  {Q  ~  Q*)a,  d^v/dar  = 

Q  ^  0.  and  the  existence  condition  for  a  solution  to  the  linear  algebra 

problem  (3.24)  (Strang  1988).  □ 


4.  Some  properties  of  the  poles  of  covariance  control  systems 

As  described  in  §  2.  the  set  of  controllers  which  assign  a  specified  state 
covariance  X  to  the  system  can  be  parametrized  by  5  =  —  S*.  and  hence  the 
location  of  closed-loop  system  poles  is  also  dependent  only  on  S  for  the  given 
X.  Some  properties  of  the  closed-loop  poles  resulting  from  this  dependence  will 
be  studied  in  the  remainder  of  this  section. 

Theorem  4.1:  Suppose  that  a  specified  state  covariance  X  can  be  assigned  to  the 
system.  Among  all  controllers  that  assign  X,  the  sum  of  the  closed  loop  poles  is 
constant . 

For  the  proof  of  Theorem  4. 1  we  need  the  following  lemma. 

Lemma  4.2:  For  any  skew-symmetric  matrix  S  =  -S*  and  any  symmetric  matrix 
X  —  X* .  we  have 


tr(5Z)  =  0 

Proof: 

tr(5Z)  =  tr(.^5) 
tTiSX)  =  tr[(5A')*]  =  -trfA'S) 

that  is 


(4.1) 


tr(A'5)  =  -trlA'S)  =  0  □ 

By  using  Lemma  4.2  we  can  prove  Theorem  4.1  in  the  following  way. 

Proof  of  Theorem  4.1: 

2  A, (A  -K  BG.V/)  =  2  +  BGiM  +  BGzSGiM) 

/■=  1  ,=  1 

=  tr(A  -h  BGiM  -I-  BGzSGy.VI) 

=  tr(A  -f  BGiM)  +  iriBGzSG^M) 
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From  (2.5).  (2.14)  and  (2.17),  we  have 

[■^  +  5(Gi  +  G2SGi)M]X  +  A'[.4  +  B{Gi  +  G2SG2)M]*  -r  D^Dq  =  0 

(4.2) 

Since  this  is  true  for  all  5  =  -5*,  we  can  set  5  =  0  and  obtain 

(A  +  BGiM)X  +  X(A  +  BGiM)*  +  DoD§  =  0  (4.3) 

By  subtracting  (4.3)  from  (4.2),  we  have 

(BG2SG2M)X  +  X(BG2SG2M)*  =  0  (4.4) 

which  means  that 

BG2SG2MX  =  5  (4.5) 

where  5  is  a  skew-symmetric  matrix.  Equation  (4.5)  can  also  be  written  as 
follows: 

=  SX-^  (4.6) 

Now  by  using  Lemma  2,  we  obtain 

tT{BG2SG2M)  =  tr(5Z’')  =  0  (4.7) 

and  hence 

n,  +  n, 

2  A, (A  -K  BGM)  =  tr(>l  +  BGiM) 

1=1 

which  is  independent  of  S.  This  completes  the  proof.  □ 

Remark  4.1;  Since  the  system  [A  +  B(Gi  4-  G25G3)A/,  Dq]  is  always  controll¬ 
able  and  X  is  chosen  to  be  positive  definite,  the  closed-loop  system 
A  +  B(Gi  -h  G2SG2)M  retains  its  stability  for  any  skew-symmetric  matrix  S. 
Theorem  4.1  tells  us  in  addition  that  the  real  part  of  every  closed-loop  pole  is 
bounded  by  some  number  which  is  independent  of  S. 

In  the  following  we  study  another  property  of  the  closed-loop  system  poles 
for  the  case  where  dim  (5)  =  2[dim(5)  «  rank  B  «  number  of  control  inputs].  In 
this  case  S  can  be  parametrized  by  a  single  parameter  a  in  the  following  way: 

5  =  a'52,  Vor  (4.8) 

where 


and  the  characteristic  polynomial  of  the  system  is  then 
A(j)  4  \sl  -  (A  -t-  SGjA/  +  aBG-,S^G2M)\ 

(4.9) 

=  \sl  -  (A  -H  BGM  |/  -  a(sl  -  A  -  BGiM)-^BG2S2G2M\ 

In  general,  we  almost  always  have  (Davison  and  Wang  1973) 

A, (.4  4-  BGiM)  i-  XiiA  +  BG^M  +  aBG2S2G2M),  Vi.  j.  a^O 
if  (A  +  BG\M,  B)  is  controllable.  This  condition  is  satisfied  because  we  assume 
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that  {A,  B)  is  controllable.  Hence,  we  have 

r,[A(5)]  =  r,[\l  -  a{sl  -  A  -  BG^M)'^  BCiSzGyM],  (4.10) 

where  r,{  • )  denotes  the  /th  root  of  a  polynomial.  Again  by  exploiting  a  well 
known  result  in  the  theory  of  multivariable  root  loci  (Kouvaritakis  and  Shaked 
1976),  we  obtain 

Vim  {r,[A(5)]}  =  Zi[(s!  -  A  -  BG2S2G^M]  (4.11) 

with  Zii‘)  denoting  the  /th  transmission  zero  of  a  system  which  can  be  either 
finite  or  infinite.  Since  the  system  in  (4.11)  is  strictly  proper,  we  can  draw  the 
following  conclusion  by  considering  Theorem  4.1. 

Corollary  4.3:  For  the  case  where  dim  (5)  =  2,  there  is  at  least  a  pair  of  poles 
of  the  covariance  control  system  tending  to  infinity  in  the  direction  parallel  to 
axis  and  -jtu  axis  respectively  as  a  tends  to  infinity. 

Remark  4.2:  Theorem  4.1  and  Corollary  4.3  describe  an  interesting  property  of 
covariance  control  system  poles.  This  property  can  be  used  to  study  the  root  loci 
of  covariance  control  systems,  for  example  to  locate  the  system  poles  in  a 
certain  region  in  the  complex  place.  This  property  will  be  shown  in  Example 
5.1.  □ 


5.  Example 

To  illustrate  the  theory  presented  in  previous  sections,  we  give  an  example 
here. 


Example  5.1:  By  solving  the  problem  of  assigning 


=  10-^ 


"8-5  0  O' 

-5  5  0  0 

0  0  4-5  -5 

0  0  -5  7-5 


to  the  plant  (a  lightly  damped  flexible  beam  with  two  modes  (Hsieh  1990)), 


0  1 
-0-1  -001 


0 

0 


0 

0 


0 

0 

0 

-0-01 


0 

0 

1 

-0-005 


D.WD*  =  10--V,  .Vo  =  0 


via  state  feedback,  we  have  from  (2.11)-(2.13) 

Cs  =  -2b;qp(2i  -  b,b;)x;^  +  b;sb,b;x. 

Using  the  singular  value  decomposition  of  Bp  given  by 

■^b 

0 


-1 


5p  =  [Um  Ub,] 
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we  obtain 

Gs  =  -\b;Qp{2i  -  BpB-)X-^  +  b;u^iSu^^x;^ 
By  minimizing  the  cost  function 

6’  =  ir  (UR)  =  XT(G,X^GtR) 

where  R  is  chosen  as 


we  obtain  the  optimal  5: 

“^opt  “  ^opt 

where  OTopt  =  1-8847  x  10  and  the  corresponding  minimal  cost  value 
=  3-4258  X  10-^  for  5  =  ^op,  J 

which  is  smaller  than  either 

w  =  3-5133  X  10"^  for  5  =  0 
or 

V  =  6-1567  X  lO^  for  5  =  52  = 

If  our  purpose  is  not  to  minimize  the  control  energy  but  to  assure  that  all  the 
poles  of  the  covariance  control  system  be  located  within  the  sector  of  ±  45°  in 
the  complex  plane,  we  can  find  from  the  root  loci  in  Fig.  5.1  the  critical 
OTc  =  8-35  X  10“''  such  that  a<as  guarantees  that  the  damping  ratio  of  the 
covariance  control  system  is  larger  than  0-707.  The  root  loci  of  the  system  with 
respect  to  5  =  aS2  are  given  in  Fig.  5.1. 


Figure  5.1.  Root  focus  for  constant  covariance. 
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To  study  the  time  response  of  the  covariance  control  system,  three  different 
5  (5  =  ctopiS2^  (x^S2  and  52)  are  chosen,  and  the  impulse  responses  of  the 
corresponding  closed-loop  systems  are  shown  in  Fig.  5.2.  It  can  be  seen  from 
Fig.  5.2  that  these  three  different  systems  have  very  similar  impulse  responses 
y(f).  This  is  because  these  systems  have  the  same  output  covariance  matrix  Y 
(recall  from  the  theory  that  5  does  not  influence  Y  or  X),  Notice,  however,  the 
influence  of  5  on  the  control  variable  from  Fig.  5.2. 

Remark  5.1:  Some  poles  of  the  covariance  control  system  with  5  =  52  are  too 
large  to  be  shown  in  the  properly  scaled  Fig.  5.1,  and  hence  the  poles  for  this 
case  have  not  been  plotted  here.  To  conserve  space,  only  y(l)  and  u(l)  are 
plotted  to  represent  the  output  y(r)  and  control  variable  ii{t). 

6.  Conclusion 

It  is  well  known  (Skelton  and  Ikeda  1989,  Yasuda  and  Skelton  1990)  that  all 
controllers  which  assign  a  specified  state  covariance  X  to  the  system  can  be 
parametrized  by  a  free  skew-symmetric  matrix  5.  In  this  paper,  this  freedom  is 


t  (sec! 


t  (sec) 


i  (sec)  t(scc| 


78 


Minimal  energy  covariance  control 


used  to  minimize  the  control  energy;  that  is,  among  all  the  controllers  which 
assign  a  given  X  to  the  system  we  have  derived  the  controller  which  uses  the 
least  energy. 

Some  properties  of  closed-loop  system  poles  with  respect  to  S  are  also 
revealed.  In  classical  root  locus  theory  (for  excess  poles  over  zero  of  2  or  more), 
it  is  known  that,  as  the  open  loop  gain  goes  to  infinity,  the  sum  of  the 
closed-loop  poles  is  a  constant  (but  stability  is  not  guaranteed).  A  modern-day 
counterpart  of  this  'pole  conservation'  principle  is  presented  by  showing  that,  as 
the  controller  is  changed  over  the  entire  set  of  controllers  that  preserve  the  same 
positive  state  covariance  matrix,  the  sum  of  the  closed-loop  poles  is  a  constant 
(and  stability  is  guaranteed). 
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Parametrization  of  All  Linear  Compensators  for 
Discrete-time  Stochastic  Parameter  Systems* 

ENGIN  YAZt  and  ROBERT  E.  SKELTON* 

A  characterization  of  all  assignable  state  covariances  and  a  parametrization 
of  all  linear  stabilizing  output  feedback  controllers  that  achieve  this 
assignment  are  given  for  discrete-time  stochastic  parameter  systems. 

Key  Words — Stochastic  control;  stability  robustness;  discrete-time  systems;  feedback  control. 


Abstract — For  discrete-time  stochastic  parameter  systems, 
this  paper  presents  a  characterization  of  all  stale  covariances 
assignable  by  a  linear  controller  and  a  parametrization  of  all 
controllers  that  achieves  a  desired  covariance.  These  results 
indirectly  provide  the  parametrization  of  all  linear  fixed- 
order  compensators  which  are  mean  square  stabilizing  for 
this  class  of  systems.  The  paper  also  includes  robustification 
of  the  derived  compensators  and  an  example  to  illustrate  the 
results. 


INTRODUCTION 

This  paper  considers  the  static  and  dynamic 
output  feedback  control  of  discrete-time  stoch¬ 
astic  parameter  systems.  Such  systems  are  also 
called  state  (control)  dependent  or  multiplicative 
noise  models  or  systems  with  white  parameters. 
The  interest  in  such  models  stems  from  several 
application  areas  such  as  satellite  attitude  control 
(McLane,  1971:  Sagirow,  1972),  vibration  study 
of  structures  and  mechanical  systems  (Bolatin, 
1984;  Ibrahim,  1985),  chemical  reactor  control 
(Wagenaar  and  DeKoning,  1989),  macro¬ 
economics  (Aoki,  1976),  population  dynamics 
(Bartlett,  1960:  Tsokos  and  Padgett,  1974; 
Mohler  and  Kolodziej,  1980),  random  amplitude 
modulation  in  filtering  (Nahi,  1969;  Rajasekaran 
et  aL,  1971;  Tugnait,  1981),  random  roundoff 
errors  in  digital  control  (Liu  and  Kaneko,  1969; 
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Rink  and  Chong,  1979a,  b;  VanWingerden  and 
DeKoning,  1984),  analysis  of  circuits  (Willsky 
and  Marcus,  1976;  Michel  and  Miller,  1977),  and 
recently  in  robustness  studies  and  robustifying 
existing  controllers  (Willems  and  Willems,  1983; 
Yaz  and  Yildizbayrak,  1985;  Bernstein  and 
Haddad,  1987b;  Yaz,  1988a,  1989b,  1992). 

We  will  confine  our  treatment  to  discrete-time 
system  models.  Such  models,  for  example,  may 
be  the  result  of  random  sampling  of  continuous¬ 
time  processes  where  the  randomness  may  be 
caused  by  the  choice  of  a  human  operator  in  the 
control  loop,  a  mere  absence  of  data,  or  it  may 
be  carried  out  to  observe  the  underlying 
inter-sample  behavior  (DeKoning,  1988).  Digital 
control  using  a  computer  with  finite  word  length 
(Liu  and  Kaneko,  1969;  Rink  and  Chong, 
1979a,  b;  VanWingerden  and  DeKoning,  1984) 
is  another  reason  for  the  appearance  of 
discrete-time  stochastic  parameter  models. 
When  continuous-time  systems  given  by  an  Ito 
differential  equation  with  state-  and  control- 
multiplied  Wiener  noise  effect  are  uniformly 
sampled,  such  models  arise  again.  More 
recently,  random  parameters  are  introduced  into 
the  problem  formulation  to  achieve  an  extra 
degree  of  stability-robustness  in  controller  and 
estimator  designs  (Willems  and  Willems,  1983; 
Yaz  and  Yildizbayrak,  1985;  Bernstein,  1987a,  b; 
Yaz,  1988a,  1988b,  1992)  which  again  necessit¬ 
ates  the  consideration  of  discrete-time  stochastic 
parameter  models. 

Motivated  by  the  application  possibilities 
enumerated  above  and  also  by  the  elegance  of 
the  mathematics  involved,  many  researchers 
contributed  to  this  field.  We  will  simply  give  a 
few  references  and  refer  the  reader  to  the 
excellent  survey  papers  (Malyshev  and  Pakshin, 
199()a,  b).  The  dynamic  output  feedback  control 
of  discrete-time  stochastic  parameter  systems  has 
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been  considered  in  Pakshin  (1978).  Bernstein 
and  Haddad  (1987b),  Yaz  (1988b),  Phillis 
(1990),  DeKoning  (1992).  Pakshin  (1978)  is  on 
the  necessary  conditions  for  the  mean  sc^uare 
optimality  of  a  strictly  proper  full-order  (has  the 
same  dimension  as  the  state)  linear  compensator 
for  such  systems.  Bernstein  and  Haddad  (1987b) 
obtain  necessary  optimality  conditions  for  both 
static  and  fixed-order  dynamic  output  feedback 
controllers.  Yaz  (1988b)  derives  sufficient  condi¬ 
tions  for  the  mean-square  stabilization  (the 
results  are  also  true  for  almost  sure  stabilization) 
by  strictly  proper  full-order  compensators.  Phillis 
(1990)  operates  in  the  framework  of  Pakshin 
(1978)  but  extends  the  results  to  minimax  control 
for  systems  with  unknown  noise  covariances. 
DeKoning  (1992)  introduces  the  concept  of 
mean-square  compensatability  which  is  the 
ability  to  mean-square  stabilize  such  a  system  by 
a  linear  strictly  proper  time-invariant  compen¬ 
sator  of  full-order.  Necessary  and  sufficient 
conditions  for  the  compensatability  as  well  as  the 
computation  of  optimal  compensators  are 
presented. 

In  the  present  work,  we  will  be  interested  in 
static  and  fixed-order  dynamic  output  feedback 
covariance  assignment  for  discrete-time  stochas¬ 
tic  parameter  systems.  First,  necessary  and 
sufficient  conditions  for  the  assignability  by  a 
static  output  feedback  of  a  given  covariance  (the 
steady  state  second  moment  of  the  system  state) 
will  be  derived.  Next,  all  controllers  that  will 
achieve  this  assignment  will  be  parametrized. 
The  assignability  conditions  will  be  interpreted 
in  light  of  existing  system  theoretic  concepts  for 
this  class  of  systems.  Then,  this  design  is 
robustified  to  allow  parameter  variations  in  the 
operation  and  a  robust  controller  which  main¬ 
tains  mean-square  and  almost-sure  boundedness 
of  the  system  state  is  given.  All  of  these  results 
are  then  generalized  to  the  case  of  fixed-order 
dynamic  compensation.  An  example  is  given  to 
illustrate  the  use  of  the  proposed  techniques. 
This  paper  is  a  much  improved  version  of  its 
predecessor  (Skelton  et  al.,  1991)  in  several 
ways:  first,  the  present  model  additionally 
includes  control-dependent  noise  in  the  state 
equation  and  state-dependent  noise  and  additive 
noise  in  the  measurement  equation  in  a  unified 
framework,  where  the  multiplicative  noises  are 
correlated  (this  helps  in  realistic  modeling  of 
several  physical  phenomena).  Second,  a  different 
and  more  direct  approach  is  used  in  deriving  the 
results  with  interpretations  of  assignability 
conditions  using  well-known  system  theoretic 
concepts.  Third,  the  robustness  study  is  more 
general  in  that  it  encompasses  both  deterministic 
and  stochastic  model  uncertainties. 


MODEL  AND  PRELIMINARIES 

Consider  the  discrete-time  stochastic  para¬ 
meter  system 

=A%(u))x\  B\((d)u^  -h  u*((o),  (1) 

where  xj.  e  R" .  u*  €  R"'  and  Ai.  B\,  and  u*  are 
all  composed  of  white  noise  (time-wise  inde¬ 
pendent)  elements.  and  B%  are  uncorrelated 
with  u*  which  has  a  zero  mean  (denoted  by 
u*  =  =  0)  and  a  constant  covariance  of  Z„. 

weQ  where  (Q,  ST,  ,?)  is  a  fixed  probability 
space.  The  measurement  equation  is 

y*  =  Ci(cy)xi  +  w;,(a)),  (2) 

where  y*  6  p  <  n  and  the  matrix  of  white 
noise  elements  Ci  is  uncorrelated  with  the 
additive  noise  vectors  u*  and  with  zero  mean 
and  covariance  >  0,  but  we  allow  correlation 
of  A%,  B%,  and  C*.  For  simplicity,  let  w*  be 
uncorrelated  with  all  other  noises,  let  all 
multiplicative  noises  be  weakly  stationary  and  all 
noises  be  independent  of  the  initial  state  x„. 
Note  that  the  above  representation  includes 
deterministic  parameter  systems  (by  simply 
setting  the  covariances  of  multiplicative  noises  to 
zero)  and  the  usual,  more  structured  parameter 

representation  with  A*(cu)  =  A„-(- E  4(a))A',, 

etc,  although  the  input  matrix  B%{(o)  in  our 
model  will  be  restricted  later  to  obtain  stronger 
results. 

We  include  a  few  system  theoretical  notions 
for  the  above  class  of  systems  to  facilitate  the 
discussion.  The  system  (1)  or  the  pair  (Ai,  Bi)  is 
called  mean  square  (m.s.)  stabilizable  if  there 
exists  a  constant  state  feedback  controller  such 
that  this  controller  renders  the  state  of  system 

(1)  m.s.  bounded  (sup  E{||xjp}  <=o)  for  all  Z„. 

k»{) 

A  simple  test  for  m.s.  stabilizability  is  given  in 
DeKoning  (1982).  It  turns  out  that  a  m.s. 
stabilizing  control  is  almost  surely  (a.s.),  or  with 
probability  one,  stabilizing  for  this  class  of 

systems  (Yaz,  1988a)  (sup||x*||<x  with  prob- 

ability  one).  The  (A^,  C*)  pair  for  the  model 
•*1+1  =  y*  =  Cl(<w)-*1  is  called  m.s. 

observable  if  E{||y*||-}  =0  for  all  k>0  implies 
Xo  =  0.  The  definition  is  shown  in  DeKoning 
(1982)  to  result  in  the  following  test  for  m.s. 
observability.  Define  ^ R”’"'  by 

E{A^'XA^}.  (3) 

Note  that  the  subscript  k  is  dropped  due  to  the 
weak  stationarity  of  the  noise  elements.  The 
necessary  and  sufficient  condition  for  the  m.s. 
observability  is  that  the  observability  Grammian 
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satisfies 

e^[n{n  +  \)l2]~\,  (4) 

*  =*0 

where  and  ^"{X)  =  X. 

Obviously  for  a  (2  >0.  Q^'^)  is  always  m.s. 

observable  for  any  Ai. 

The  following  results  will  also  be  useful  in  the 
sequel. 

Lemma  1  {DeKoning,  1982).  Consider  the 
stochastic  algebraic  Lyapunov  equation: 

X^3d{X)  +  I.,.,  2„=SJ’>0. 

where  si  is  given  by  (3). 

(i)  If  is  a  stable  transformation  [which  is 
equivalent  to  the  m.s.  boundedness  of  the 
state  of  unforced  system  (1)],  then  there 
exists  an  A' s  0  which  is  the  unique  real 
symmetric  solution. 

(ii)  If  there  exists  a  solution  X>0,  and 

(i4J,  is  m.s.  observable,  then  is  a 

stable  transformation  and  A”  >  0. 

Lemma  2.  The  stability  of  the  transformation  ^ 
given  by  (3)  is  equivalent  to  that  of  si*: 

ffnxn_^  ^nxn  gjygf,  [jy 

^*(X)  =  E{A^XA^'}. 

Proof.  The  proof  simply  follows  from  the 
necessary  and  sufficient  condition  for  the  m.s. 
stability  of  si  (Kalman.  1961); 

p{si)  =  p{A‘  <^A^)<  I, 

where  the  first  one  is  the  operator’s  spectral 
radius,  and  the  second  one  is  the  spectral  radius 
of  the  matrix  which  is  the  expected  value  of  the 
Kronecker  square  of  the  A^  matrix.  If  the 
properties  (A  <S)  B)^  =  A^  iS>  p{A)  =  p(A^), 
E{A^{(i))}  =  [£{/4(cu)}]^  are  used  in  the  above 
condition,  we  obtain 

p{:i)  =  p{si*)<\, 
completing  the  proof. 

STATIC  OUTPUT  FEEDBACK 

(i)  Assignability  and  covariance  assignment 
Let  us  now  assume  that  Bi(co)  =  b^{a})B^ 
where  6*(<o)  is  a  scalar  white  noise  sequence, 
and  try  to  assign  the  state  covariance  (second 
moment)  X  =  lim  by  the  control 

/tc— .3C 

Uk  =  Ky,.  (5) 

The  closed-loop  system  is 
4.^ ,  =  (Ai  +  B‘KC%)x\  -b  V*  +  b*  B^Kwi,  (6) 
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and  if  the  control  is  mean  square  stabilizing,  the 
steady  state  covariance  of  the  state  vector 
satisfies 

X  =  {A‘  +  bB^KC)XlA"  +  bB^KCf 

+  2v  +  ^B^K2„K'^B’\  (7) 

Independence  of  the  noises  is  utilized  in  the 
simplification  resulting  in  (7).  Upon  rearranging, 
(7)  yields 

X-A^XA^'-X^ 

=  B^KbCXA^'  +  bA^Xa'K^B^' 

+  B^K[b~CXC'  +  Pl^]K^B^'.  (8) 

Completing  the  square  on  the  right  side,  we  will 
obtain 

X -A^XA’"- 1.,. 

=  (B^K  +  G{X))[b-CXC'  +  Pi,,] 

_  x(B^K  +  G{X)f 

-G{X)[b-axC^  +  pT^]G^(X),  (9) 

where 

GiX)  4  bA^XC\PcxC'  -b  P2„.)-'.  (iQ) 
Rearranging  once  more  yields 

X-A^XA^'-'E^+bA^XC' 

X  (b-CXC'  -b  P-E^r'bCXA^' 

=  {B^K  +  G(X))TT^{B^K^G{X))f  (11) 

At  this  point,  X  must  be  chosen  such  that  it 
renders  the  left  side  of  (11)  non-negative  definite 
with  rank  not  exceeding  p,  which  is  required  by 
the  form  of  the  right  side  of  (11).  In  that  case, 
we  have 

LL^  =  {B^K  +  G(X))TT^iB^K  +  GiX)V  (12) 

with  the  obvious  definition  of  the  new  variables 
LsR"^”,  with  detfrj^tO.  Hence,  for 

an  orthogonal  matrix  U  it  is  true  that 

LU  =  (B^K  +  G{X))T  (13) 

or 

B^K  =  LUT-'-G{X)  (14) 

which  can  be  solved  for  K  (Collins  and  Skelton 
1987)  as 

K  =  B‘\LUT-'  -  G(A'))  +  (4  -  B^'B^)Z,  (15) 

where  B^  denotes  the  unique  Moore-Penrose 
pseudo-inverse,  for  any  arbitrary  Z  if  and  only  if 

B^B^’[LUT-'  -  G(X)]  =  LUT-'  -  GiX)  (16) 
or 

(1  -  B^B'')LU  =  (/  -  B^B^’)GiX)T, 
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which  is  equivalent  to 

(/  -  -  2.  ](/  -  B^B^')  =  0 

(17) 

using  (10)  and  (12).  The  matrix  U  can  also  be 
found  by  (Collins  and  Skelton,  1987) 

U=Ti  block  diag  [Ip,  U]Vl,  (18) 

where  the  singular  value  decompositions  (/- 
B^B"  )L  =  Wf  block  diag  [A,  0]T^,  (/  -  B‘B^') 

G{X)T  =  Wi  block  diag  [A,  OJTJ  are  used  with 
Q  ^  row-orthonormal,  and 

A  6  R'’  ’’  contains  all  the  nonzero  singular 
values.  Summing  up,  we  have 

Theorem  1.  A  given  state  covariance  X  is 
assignable  to  system  (1)  by  some  control  (5)  if 
and  only  if  it  makes  the  left  side  of  (11) 
non-negative  definite  with  rank  not  exceeding  p 
and  it  satisfies  the  consistency  condition  (17).  If 
X  is  assignable,  all  controllers  assigning  X  are 
given  by  (15),  (18). 

Note  that  if  the  covariance  assignment  is 
successful  and  (Ai^  2i‘)  is  m.s.  observable,  then 
by  Theorem  4.5  of  DeKoning  (1982),  ([A1  + 
b^B^KC.Y,  K'".  (Py'^B^KZ]^])  is  m.s.  observ¬ 
able,  and  Lemma  1,  combined  with  the  results  of 
Yaz  (1988a)  guarantees  a.s.  boundedness  of  the 
system  state. 

(ii)  On  the  existence  of  solutions  to  assignability 
conditions 

Now  let  us  interpret  the  assignability  condi¬ 
tions  starting  with 

X-A^XA^'-Hp+bA^Xa" 

X  ib^CXC'  +  r-ZJ- 'bCXA^"  >  0.  (19) 

It  is  easy  to  see  that  this  inequality  can  be 
rearranged  to  give 

X>[A^‘  -ba'G^(X)YX[A^'  -ba'G^(X)] 

+  pGiX)Z„G^(X)  +  i:p^it>(X),  (20) 

where  G(X)  is  given  by  (10).  It  is  shown  in 
Yaz  (1989a)  that  the  existence  of  X  satisfying 
(20)  is  equivalent  to  the  m.s.  stabilizabil- 
ity  of  (Ai ,  b^cY)  for  a  m.s.  observable 
pair  {Al\  2i^). 

Now,  considering  equation  (17),  we  can  write 
(/  -  B^B^') 

x[X-  (A‘  +  bB^K)X{A^  +  bB^Kf  - 1^] 

x(l-B^B^')  =  0,  (21) 

by  using  the  properties  of  the  Moore-Penrose 
pseudo  inverse: 

(I-B^B^’)B^  =  0,  B^\l-B^B^')  =  0  (22) 


for  an  arbitrary  K.  So.  according  to  Lemma  1.  if 
(Ai,  bi,B")  pair  is  m.s.  stabilizable  (i.e.  there 
exists  a  K  such  that  (Ai  +  b^B^K)  leads  to  a 
stable  transformation,  then  there  exists  a 
solution  A"  SO  to  the  equation 

,Y  =  rA^  +  bB^K)X{A^  +  bB^KY  +  (23) 

which  implies  (21).  We  have  actually  used  the 
property  presented  in  Lemma  2  that  the 
transformations  sd  and  sd*  have  the  same 
stability  properties.  Therefore,  one  can  see  that 
the  m.s.  stabilizability  of  (A*,  b^B‘)  is  sufficient 
for  the  existence  of  a  solution  to  the  consistency 
equation  (17). 

The  above  discussion  is  included  to  relate  the 
assignability  conditions  individually  to  well- 
known  system  theoretic  concepts.  Obviously,  for 
assignability,  the  same  covariance  must  satisfy  all 
the  assignability  conditions  simultaneously  which 
means  that  the  system  theoretic  conditions 
associated  with  individual  assignability  condi¬ 
tions  as  a  whole  are  neither  necessary  nor 
sufficient  for  the  assignability  of  a  specific 
covariance. 

(iii)  Robust  design 

It  is  possible  to  robustify  this  controller  so  as 
to  accommodate  erroneous  modeling  of  para¬ 
meter  statistics  or  parameter  perturbations  by 
making  the  closed-loop  system  a  prescribed 
degree  of  m.s.  stable  via  modifying  the  design 
equations.  Let  us  change  equation  (7)  to 

Xc  =  cr(A"  -h  bB^K^a)X„{A^  +  bB^K^Cf 

+  a^b^B*K,2„KlB^"  +  2,  (24) 

with  cx  t>  ].  which  will  modify  the  non-negativity 
condition  as 

X  >  ar-[A"^A^'  -  bA^XC" 

X  (b^axa" + Pi:,,)-^bajcF]  +  5; 

=  X.)  (25) 

and  the  consistency  condition  (18)  changes  to 
(I-B^B^')[X,-a^A^X,A^'-l„] 

X  (/ -  =  0,  (26) 

which  if  holds  yields  the  control  gain: 

K,  =  -  G(A'„)]  +  (Ip  -  B^'B^)Z, 

(27) 

with  U  being  found  similarly  as  in  (18)  and 
LpLl=X„-^{ot,X„), 

Tl = b^cx^c^ + Ps,.. 

Since  in  inequality  (25).  as  can  completely  be 
absorbed  into  the  A*  s.  the  system  theoretic 
properties  sufficient  to  lead  to  (25)  will  change  to 
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the  m.s.  stabilizability  of  and  the 

m.s.  observability  of  (tMi ,  which  will  be 
shown  to  be  equivalent  to  the  m.s.  observability 
of  (A^J,  Zi^).  Since  the  new  observability 
Grammian  satisfies 


k^i) 

=  (Zi'^,  a[>irf(Z„)]‘'^ . aV'(2v)r 


^T/2 


=  (29) 


the  m.s.  observability  of  {ocA^k^  is  equiv¬ 
alent  to  the  full  rank  property  of  But 

rank 

=  rank  (pi^,  ,  [^^(2.)]^'^] 

X  diag  [/,  or/,  ,  a^l\) 

=  rank  (^),  (30) 


with  |  =  for  nr=l,  therefore  m.s.  observ¬ 
ability  of  (i4i\  2i^)  and  2i^),  ar>  1  are 

equivalent. 

Equation  (26)  will  also  lead  to 
(/  - 

X  [X^  -  or  V  +  bB^K„)XM"  +  bB^K^f  -  2v] 

x(/-S"S^^)  =  0  (31) 

similar  to  the  development  when  or  =  1,  so  using 
Lemma  1  again,  the  existence  of  an  Arty>0  is 
implied  by  the  m.s.  stabilizability  of  {<xA%y  b^B^) 
pair. 

If,  for  example,  2v>0  or  (>li^  2i^)  is  m.s. 
observable  (please  see  the  comment  below 
Theorem  1)  and  the  assignability  conditions  are 
satisfied  for  some  X^  >0,  then  by  Lemma  1,  the 
operator  defined  by 

^a(A^a)  =  (x\A^  +  bB^K^C)XM"  +  bB^lCa^Cy 

(32) 

is  a  stable  one  or  the  spectrum  of  the  operator 
is  inside  a  disc  of  radius 
which  will  be  called  a  m.s.  stability  margin  of 
1  -  a~^.  If  the  covariance  controller  based  on 
the  equation  (24)  is  used  in  system  (1),  the 
actual  second  moment  satisfies 


Xd-X^-X,  we  have  from  equations  (24)  and 

(33) : 

=  (A^  +  bB^K^C)XAA^  bB^K^cY 
+  ( ar“  -  [)[(A^  +  bB^K.OXM"  +  bB^K^y 

(34) 

Since  is  m.s.  stabilizing  with  a  stability 
margin  1  -  or'^,  it  is  m.s.  stabilizing.  Also 
a“>l.  Therefore,  the  right- most  term  above  is 
non-negative  definite.  Hence,  it  follows  from 
Lemma  1  that  there  exists  a  solution  ^  0  to 

(34) ,  which  gives  X^X^  or  the  true  assigned 
covariance  can  be  made  to  satisfy  upper  bounds 
included  in 

Theorem  2.  Suppose  that  (A^^  Z|;”)  is  m.s. 
observable.  Then  the  control  gain  (27)-(28)  will 
result  in  a  m.s.  stability  margin  I  -  as 
expressed  by  equation  (32)  and  will  satisfy  the 
second  moment  upper  bound  A"  s  A'^  if  and  only 
if  (25)  holds  with  X^  ~  4>(ar,  X^)  having  rank  not 
exceeding  p  for  some  a  >  1  and  (26)  is  true. 

Now  let  us  see  how  this  extra  degree  of 
stability  helps  in  the  presence  of  parameter 
perturbations.  Suppose  that  true  parameters 
statistics  are  not  known  for  A%y  b^  and  C%  and 
we  estimate  the  second  moment  operators 

blCa{-)cL  and  bM)Cl-  This 
obviously  encompasses  deterministic  as  well  as 
stochastic  model  uncertainties.  We  did  not 
include  any  robustness  results  related  to 
erroneous  modeling  of  additive  noise  effects 
because  such  errors  will  not  result  in  the 

destabilization  of  the  system.  In  the  choice  of  the 
design  values  for  the  parameter  statistics,  it  is  of 
utmost  importance  to  make  a  selection  in  such  a 
way  as  to  enhance  the  satisfaction  of  the 

assignability  conditions.  Suppose  that  we  would 
like  to  obtain  a  stable  closed-loop  system 

operator  for  some  /3  >  1.  This  means  that 
under  the  proper  assignability  conditions,  there 
exists  a  unique  positive  definite  solution  X^  to 

Xti  =  +  bjB^KpCj)Xp{A:,  +  bjB^K^Cy 

+  +  Z,„  (35) 

which  forms  the  basis  of  our  robust  control 
design.  We  shall  use  a  Martingale  (stochastic 
Lyapunov)  type  analysis  to  determine  how  much 
deviation  from  the  true  model  statistics  is 

possible  without  causing  instability. 


X  =  (A^  +  bB^K„C)X{A^  +  bB^K^Cy 

+  +  (33) 

Let  us  noW  see  how  this  actual  covariance  is 
related  to  the  design  value  X^^  Defining 


By  using  Lemma  2  for  equation  (35),  we  can 
see  that  there  exists  a  positive  definite  solution 
to 


x;  =  ^\A^^  b,B^K,C,YXl{A^,  +  bjB^K^C,) 
+  P^-plB^K^i:„Kj,B'' +1,..  (36) 
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where  we  will  assume  for  simplicity  that  I„  >  0. 
Define  the  function  v,=x{x;xl  which  will 
serve  as  an  auxiliary  Lyapunov  function.  Define 
the  difference 


- }  -  v*  (37) 

which  from  (6)  gives 


if*  =  [(A;y  -FA")'  X;iA^j  -FA")  -  X}\x\ 

+  P. 

(38) 

where  and  p  are  defined  by 

Adk  Adk  bdkB  KpCdfi 

(39) 

A^  =  A 

k  -  A^dk  +  b,B^Kf,Cl  -  bdkB^KpO,, 

(40) 

P  = 

iP^x;v  +  b^w‘  k^b^‘x;b^Kp  w>o. 

(41) 

Since  for  any  ar>0,  it  is  true  that 

A^Jx;^ 

‘  +  A^"x;A‘-d 

Xj 

< 

*■  ^ 

<I 

7 

+ 

VI 

(42) 

letting  or  =  -  1,  and  substituting  from  (36),  we 

have 

VI 

r  A"'x*A" 

-  p-¥dB^Kpi:^KlB^^  -  2,  +  p. 

(43) 

For  m.s.  and  a.s.  boundedness  of  the  perturbed 
system  state,  it  is  sufficient  that  the  expression  in 
the  square  brackets  be  negative  definite  (Yaz, 
1988a).  That  gives  us  the  following  result: 


Theorem  3.  Suppose  that  the  assignability 
conditions  of  Theorem  2  (with  a  replaced  by  )3) 
are  met,  and  that  a  controller  based  on 
robustified  design  equation  (35)  is  given.  A 
sufficient  condition  to  maintain  the  m.s.  and  a.s. 
boundedness  of  the  system  state  for  the 
deterministic  and  stochastic  parameter  perturba¬ 
tions  defined  above  is  that  the  total  perturbation 
term  defined  by  (40)  satisfies  the  second  moment 
bound 


jS-  "• 


(44) 


DYNAMIC  OUTPUT  FEEDBACK 

(i)  Assignability  and  covariance  assignment 
In  this  case,  we  put  a  further  restriction  on  the 
input  ^matrix  by  making  it  time-invariant, 
^  use  an  r-dimensional  linear 

time-invariant  dynamic  compensator 

-f- 

=  C‘u:|  -I-  D‘^yi, 


that  results  in  the  closed-loop  system 

+  (46) 

where 


A‘i^  = 


'A\  +  B^D^Cl 
B^C\ 


B^a 

(47) 


The  second  moment  of  the  composite  state  is 
defined  by 


X’ 

(xn^ 


which  satisfies 


X  =  A'-^X{A^‘-y+  B^'-V{B^^Y  (49) 

if  the  controlled  system  is  m.s.  stabilized  by  the 
compensator  (45),  where 


Expanding  (49),  we  obtain 


X  =  (A  BKC)X{A  +  BKCf 
+  (In+BKI,2)V(I,,+BKI,2)T 


with 


(50) 


(51) 


O' 

0. 


O' 

Ir- 


0' 

4- 


K  = 


1X2  = 


■QC  CC- 

.5"  A^ 
(52) 

[0  4] 

.0  0.’ 


Upon  rearrangement  and  simplification 
(7,2  F/i,  =0),  we  obtain 


X  -  AXA ^ W, ,  =  BKO^ -F  AX^K^B ^ 
+  BK{Cm^  +  (53) 


Completing  the  square  on  the  right  side  gives 

a:-aa'a^-/,,f/,, 

=  [BK  -F  G{X)]{CXC^  +  InVIl2)[BK  -F  G(Ar)]^ 
-G{X)(a^+T2Vir2)G^iX)  (54) 

with 


G(X)=AJ^(a^  +  I^2VIl2r\  (55) 

The  positive  definiteness  of  the  expression  in  the 
parentheses  in  (53)  will  guarantee  the  existence 
of  the  inverse.  This  expression  is 


CA'C^ -F /12  V/ [2  = 


L  (X’Y^^ 


(56) 
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Note  that  our  positive  definite  choice  of  X, 

V  x^\ 


x  = 


>0 


(57) 


implies  that  A'"  >  0  and  X’  -  X^^{X'^y'(X^^f  > 
0  (Horn  and  Johnson.  1985).  Hence  the  positive 
definitenessjjf  (56)  is  guaranteed  if  >  0  and 
crc'  -CX^‘^{X^)-\X’'^YC'  ^  >  0.  But 

2^,  >0  is  sufficient  to  make  (56)  positive  definite, 
due  to  the  fact  that 

cx^c'  -  cx^^{X‘^)-\x^^Yc^ + 

=  cxc'  +  HAf^  -  a:^"(a:")-'(A'"")^]^' + Sh. 

(58) 

with  C*  =  C*  —  O.  Therefore,  the  inverse  in  (56) 
will  exist  if,  e.g.  A'  >  0  is  chosen  and  2^.  >  0. 

Rearranging  equation  (54)  and  substituting 
from  (55)  gives 

X  -AXA'  -luVI,, 

+  AXC’^iCXC  +  InVlJzY'C^ 

=  [BK  +  G(A')](CA'C'  +  /,2  Wr2) 

x[BK  +  GiX)y.  (59) 

We  require  that  the  second  moment  X  is  chosen 
such  that  the  left  side  of  (59)  is  non-negative 
definite  and  of  rank  not  exceeding  /?  +  r,  because 
the  right  side  has  these  properties.  Under  these 
conditions,  (59)  is  rewritten  as 


static  output  feedback  case  to  yield 
(/  -  BB'){X-AXA^- /,,  l//,,)(/  -BBA=Q. 

(65) 

Let  us  summarize  the  previous  development: 

Theorem  4.  A  given  steady  state  second  moment 
^  g /^(n+r)x(n+r)  X-X^>Q  is  assignable 
by  an  r-dimensional  dynamic  compensator  (45) 
to  system  (1)  and  (2)  with  and  2^^  >0  if 

and  only  if  X  makes  the  right  side  of  (59) 
non-negative  definite  with  rank  not  exceeding 
p  +  r  and  it  satisfies  equation  (65).  All 
compensators  assigning  X  are  given  bv  (63)  and 
(64). 


(ii)  More  on  the  dynamic  assignability  conditions 
Let  us  now  expand  on  the  assignability 
conditions  starting  with 

X  ^AXA’  -  AXC’^iCXC^ 

+  /,2V/r2)-'CXr  +  /,,V/,,.  (66) 

Upon  substitution  from  (48),  (50),  and  (52) 
and  after  a  few  manipulations  involving  the 
inverse  of  partitioned  matrices,  (66)  yields 


where 


Y  AT'n 


(67) 


LL^ --[BK  +  G{X)]TT'^[BK  +  G{X)Y  (60) 

with  the  obvious  definitions  of 

and  r  g So  for  an  orthogonal 

y  we  have 

LU  =  [BK  +  G{X)]T.  (61) 

It  is  shown  above  that  TT^>0,  so  det[r]¥=0 
and 

BK  =  LUT-'-G{X). 

The  solution  for  K  exists  if  and  only  if 

BB*[LUT-'  -  C(A')]  =  LUT-'  -  G(X)  (62) 

in  which  case,  all  solutions  are  given  by 

K  =  B%UT~'  -  G(X)]  +  (/„,,,  -  B^B)Z  (63) 

for  an  arbitrary  Z  ^  xhe  necessary 

U  matrix  can  be  found  from  (61)  as 

U=r,a  block  diag  [I,^,  (64) 

where  the  matrices  above  are  found  from  the 
singular  value  decompositions  (/  -  BB*)L{I  - 
BB*)L  =  block  diag  [A^,  0]rl,  (/  -  BB^)G 
{X)T  =  block  diag  [A^,  0]T*J/  with  %  being 
row-orthonormal,  and  Aj  €  contains  all 

the  nonzero  singular  values.  Condition  (62)  can 
also  be  simplified  in  a  manner  similar  to  the 


y  =  AT"  -  -  A^WA^'  -  2,. 

+  (FxW  +  A^WC') 

X  [C^xW  +  awe'  +  2,,]-' 

X  (A^X^a"  +  A^wa'  Y  (68) 

and 

W  =  X^-  X^%X^y\X^^y  (69) 

is  the  Schur  complement  of  X\  Since  A"  >  0  is 
chosen,  both  X"^  and  W  will  be  positive  definite. 
Therefore,  in  order  to  satisfy  (67),  we  only  need 
to  have  (Horn  and  Johnson,  1985): 

Y-X^%X^y\X^^y^0  (70) 

which  simplifies  to  the  Riccati  matrix  inequality 
in  W  with  a  cross-weighting  term 

W  >  -  (A" 

X  {cwa"  +  2,,  +  ax^cY^ 

X  (A^WC^'  +  2,  +  yxW,  (71) 

First,  note  that 
Q^Z,+A^X^A^'  -A^X^C' 

xiaFa'+z^y'ax^A^'  (72) 

is  non-negative  definite,  since  this  property  of  Q 
for  2,„  >  0  is  equivalent  to  the  same  property  of 


I 


I 
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the  partitioned  matrix  (Horn  and  Johnson 
1985): 

. 

which  is  obviously  true  since  (73)  can  be  written 
as 


■Sv 

.  0 


+  (74) 


So,  rewriting  (71)  as 

w  >  /-[w  -  wc'iawa"  +  ^  +  q 

(75) 

with 


F  =  A^-  A^x^c'r  -'ax^A^\ 
R  =  'z^  +  cx^a\ 


Note  that  the  situation  in  (66)  is  quite  different 
from  that  of  (19)  in  the  static  output  feedback 
case,  since  now  the  parameters  F  and  Q  are 
dependent  on  the  covariance  X^  =  W  + 
X^^(XT'(Xn^  whose  existence  is  sought. 
Therefore,  we  cannot  use  reachability  and 
detectability  properties  to  secure  the  existence  of 
a  solution  to  the  non-negativity  condition. 

Now  considering  condition  (65)  and  upon 
substitution,  we  see  that  it  reduces  to 

r (/  -  -  A^X^A^'  -  2„)(/  -  B^B^’)  0] 

L  0  oJ 


so  that  it  can  be  given  the  same  interpretation  as 
in  the  static  output  feedback  case,  i.e.  it  is 
implied  by  the  m.s.  stabilizability  property  of 
(^*,  B")  pair. 


(iii)  Robust  design 

To  robustify  this  dynamic  compensator,  we 
start  with  a  modification  of  equation  (51): 

Xa  =  a^(A  +  BK„C)XM  +  BK^CY 

+  a\lu  +  BKJ^2)V{Iu  +  BKJy^Y  (78) 

for  an  Xa=X^>Q  that  gives  rise  to  the 
non-negativity  condition: 

Z„  -  a'^AX.A^ -  a^IuVIu 

+  a^Axx^iC)^ + 

(79) 

with  the  same  rank  condition.  The  consistency 
condition  becomes 

(/  -  BB*){X„  -  a-AX^A^ -  a% ,  W, ,) 

X  (/  -  BB^)  =  0.  (80) 


Suppose  that  these  assignability  conditions  are 
satisfied,  then  the  control  gain  becomes 

=  B*[L„UT;'  -C{X,)]  +  [I^^^- B'B]Z 

(81) 

with  LaLl  being  equal  to  the  left  side  of 
inequality  (79)  and 

TaTl=  a-[CX,C^  +  l,.Vll2]  (82) 

the  orthogonal  matrix  U  being  found  as  in  (64). 

Again,  denoting  the  difference  between  the 
design  and  actually  assigned  covariances  by 
^d  =  X,  we  find  from  (51)  and  (78)  that 

Xa  =  (A  +  BK,C)XM  +  BK„CY 

+  -  \)[(A  +  BK^C)XM  +  BK„CY 

+  (/„  +  BKJ,2)V{hx  +  BKJnYl  (83) 

Since  >  1,  the  right-most  term  is  non-negative 
definite  and  since  stabilizes  the  system  with 
an  extra  degree  of  m.s.  stability,  the  closed  loop 
system  operator  is  a  stable  one.  Therefore,  by 
Lemma  1,  there  exists  a  solution  Ar<,>0  to  (83) 
which  implies  that  an  upper  bound  X^^X  on 
the  assigned  covariance  can  be  achieved. 

Theorem  5.  The  necessary  and  sufficient  condi¬ 
tions  for  the  assignability  of  >  0  to  (78)  are 
that  (79)  and  (80)  hold  and  that  the  left  side  of 
(79)  should  not  exceed  {p  +  r)  in  rank.  In  this 
case,  the  control  specified  by  (81)-(82)  will 
assign  a  second  moment  bound  on  the 
closed-loop  covariance  (51)  that  satisfies  equa¬ 
tion  (78)  and  the  closed-loop  system  will  have 
m.s.  stability  margin  of  1  -  a~^  and  the  a.s. 
boundedness  of  the  closed-loop  system  will  be 
guaranteed  if  (A*  +  BK^C^,  (/,,  +  BK^It2)V'^) 
is  m.s.  observable. 

The  last  statement  of  the  above  theorem 
follows  from  Lemma  1  and  the  discussion  on 
robust  design  for  static  output  feedback 
controllers. 

Let  us  now  use  this  robust  design  to 
accommodate  erroneous  or  unmodeled  para¬ 
meter  statistics.  Assume  again  that  the  available 
model  has  the  operators  Aj(-)AJ,  Q(  )AJ,  and 
0(  )Crf  instead  of  the  true  moments  of  A*  and 
Cfc  in  (52)*  Therefore,  we  base  our  design  on 

Xp  =  +  BK^Cj)XYAj  +  BKpCjY 

+  PHlu+BKf,lr.)Vil,,  +  BK^I,2Y  (84) 

assuming  that  the  modified  assignability  condi¬ 
tions  for  Xft  —  Xj^>0  are  met*  Again,  we  see 
that  the  use  of  Lemma  2  allows  the  existence  of 
a  positive  definite  satisfying 

x;  =  li-(Aj  +  BKpC,yx;iA,  +  BKpCj) 

+  )3^(/,,  +  BKpI,2)ViIu  +  BKpl,2Y.  (85) 
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A  similar  analysis  to  the  static  output  case  yields, 

i?*  =  xl[iAl  +  ^y  x;iA‘,  +  ^‘)  -  x;]x,  +  n 

(86) 

with  Am,  At,  fi  defined  by 

A‘M  =  AM  +  BKffCM  (87) 

M  =  A,-  Am  +  BKp (C*  -  Cm)  (88) 

M  =  ?'  (/„  +  BKpInVXliln  +  B/C^/,2^)  >  0. 

.  ... 

Again  using  the  fact 

<  -  i)a^/x;a^j  +  ()0'  -  i)-'A^’;r;A^  (90) 

and  substituting  from  (85),  if*  :£  -xlMx^  +  n  for 
an  A/  >  0  if 

a‘"x;a^ 

<  (/3^  -  !)(/, ,  +  BK^h.)V{lu  +  (91) 

The  right  side  of  inequality  (91)  can  be  made 
positive  definite  if  >  0,  Sh,  >  0  and  B*"  is  full 
row  rank  with  the  dimension  of  the  controller 
satisfying  r^p.  This  can  be  seen  easily  from 

det  [(/n  +  S/C^/,2)V^(/n  +  Wi2)n 

=  det  [2,  + 

X  det 
X  (2^  + 

=  det  [2,  + 

X  det  [(B"(2;:‘  + 

(92) 

which  follows  from  (52)  and  the  matrix  inversion 
lemma.  If  the  full  rank  property  does  not  hold, 
then  one  can  add  diag  [0,  sir],  0  <  f  «  1  to  the 
covariance  equation  to  make 

(/h+BVi2)V'(/„  +  SV.2)^ 

+  diag[0,  e4]>0  (93) 

if  2h,  >  0.  This  changes  the  derivation  of  the 
controller  in  a  trivial  way  and  it  can  also  easily 
be  shown  that  this  assigns  a  yet  higher  value  to 
the  covariance  (in  the  positive  semidefinite 
sense). 

Theorem  6.  Suppose  that  the  assignability 
conditions  of  Theorem  5  are  met  with  a  replaced 
with  /3>0,  and  the  corresponding  is  given 
from  (81),  where  are  given.  Let  the 

errors  in  Aj,  be  characterized  by  (88),  (91) 
where  X’^  is  defined  by  (85),  and  2^,  >0,  2^,  >  0, 
B'^B''^  >  0  [or,  if  not,  design  is  accomplished  with 
diag(0,  sip),  0<  £«  1,  added  to  equation  (84)]. 
Then  the  m.s.  and  a.s,  boundedness  of  the 
system  state  can  be  maintained  if  the  perturba¬ 
tions  satisfy  the  second  moment  bound  (91). 


EXAMPLE 

Let  US  consider  the  simply  supported  beam 
example  of  Skelton  et  ai  (1991).  The  discretiza¬ 
tion  of  equations  with  a  sampling  period  of  0.05  s 
will  result  in 


’  0.9988  0.0500  0  0 

-0.0500  0.9983  0  0 


/I  = 

0 

0 

0.9801 

0.0496 

_  0 

0 

-0.7939 

0.978lJ 

"0.0007 

-0.0013" 

B‘  = 

0.0294 

-0.0500 

0.0012 

0.0025 

_  0.0472 

0.0992. 

"0.0500 

0 

0 

0 

0 

0.0500 

0 

0 

2;  = 

0 

0 

0.0494 

-0.0186 

_0 

0 

-0.0186 

0.0599. 

C  = 

■1 

0  2 

O' 

.0.9511 

0  -0.5878  OJ 

We  assume  that  there  is  a  measurement  noise 
of  zero  mean  and  covariance  2,,,  =  lO"**/;;. 

Also,  structured  parameter  perturbations  are 
modeled  as  white  noises  such  that 


A*(to)=A^  +  a*(a>)Ai, 
Ck{o))  =  C  -hc*(w)Ci, 


where  and  are  both  standard  scalar  white 
noise  sequences  and 


”0  0  0 

0.0200  0.0065  0 
0  0  0 

0  0  0.425 


0 

0 

0 

0.0275 


(95) 


C,  =  10 


‘0,1000  0  0.02000  0‘ 
.0.1000  0  0.0500  0/ 


We  can  view  (94)  and  (95)  as  describing  the 
maximum  amount  of  parameter  perturbations 
for  this  system,  so  if  we  design  our  controller 
based  on  these  values,  then  the  closed-loop 
system  will  remain  stable  in  the  senses  described 
before,  for  all  stochastic  perturbations  with 
smaller  variances. 

Let  us  suppose  that  we  are  allowed  to  use  a 
third  order  controller  and  would  like  to  assign  a 
covariance  so  that  the  following  mean  square 
values  of  the  output  variables  dictated  by  the 
pointing  accuracy  requirements  are  satisfied: 

lim  E{[{y['r,  (y^}  =  [6.7,  2.0], 


By  using  the  simplified  assignability  conditions 
(75)-(77),  an  assignable  closed-loop  (composite) 
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state  covariance  which  satisfies  these  conditions 
is  given  by: 


1.7534 

-0.5002 

0.0106 

-0.5002 

3.0338 

-0.5213 

0.0106 

-0.5213 

1.2282 

0.5196 

-0.1013 

-0.5017 

-2.2410 

2.4778 

-2.5920 

1.4071 

-2.1106 

-0.2600 

.-7.7848 

9.0291 

-3.3558 

0.5196 

-0.1013 

-0.5017 

18.2277 

4.3542 

-5.0918 

15.7135 


-2.2410 

1.4071 

-7.7848 

2.4778 

-2.1106 

9.0291 

-2.5920 

-0.2600 

-3.3558 

4.3542 

-5.0918 

15.7135 

9.8070 

-3.3674 

23.5482 

-3.3674 

5.3178 

-17.4382 

23.5482 

-17.4382 

78.8709 

with  a  spectrum  of  (0.0486,  0.0375  ,  0.4183, 
2.1232,  4.8230,  15.3486,  95.4397}.  This  covari¬ 
ance  is  found  by  a  recursion  that  involves  solving 
an  algebraic  Riccati  equation  at  every  step.  Since 
we  do  not  yet  have  a  theoretical  convergence 
result  for  this  algorithm,  it  is  not  included  here. 

We  chose  0  =  1,  Z  =  0  for  simplicity  which 
gives  the  gain  matrix,  from  (63)  and  (64) 


-29. 1605 
-9.3691 
-1.7749 
0.8911 
.  -4.1650 


-25.8431 

22.6058 

-0.3840 

1.5140 

-4.9793 


-29.7540 

-73.9622 

-0.7218 

0.2140 

-0.0281 


33.0330  2.2520* 

80.0310  38.3695 

0.3731  0.0873 

-0.1089  0.2633 

-0.0427  -0.9907 


-0.7218 

0.3731 

0.0873 

^c  = 

0.2140 

-0. 1089 

0.2633 

_  -0.0281 

-0.0427 

-0.9907 

'-1.7749 

-0.3840' 

0.8911 

1.5140 

_ -4. 1650 

-4. 9793  _ 

c  =f 

■ -29.7540 

33.0330 

2.2520' 

.-73.9622 

80.0310 

38. 3695]“ 

A  =  f 

-29.1605 

-25.8431' 

1 

L 

-9.3691 

22.6058. 

1 

which  results  in  a  closed-loop  system  which  is  a 
m.s.  and  a.s.  stable  with  the  desired  steady  state 
covariance.  Since  this  design  guarantees  stability 
for  the  maximum  possible  perturbations  defined 
in  (93)-(94),  we  do  not  need  to  further  robustify 
this  controller. 


CONCLUSION 

This  work  contains  a  characterization  of  all 
covariances  that  a  discrete  stochastic  parameter 
system  may  have,  and  parametrizes  all  static  and 
fixed-order  linear  dynamic  output  feedback 
controllers  that  assign  a  desired  covariance. 
Robustification  of  the  controllers  is  achieved  for 
use  in  an  erroneously  modeled  system  or  in  one 
with  deterministic  and  random  parameter  per¬ 
turbations.  Although  this  work  implicitly 
achieves  a  parametrization  of  all  mean-square 
stabilizing  controllers,  which  is  of  prime 
theoretical  importance,  at  the  implementation 
stage,  we  have  had  several  difficulties.  If  a 
desired  covariance  can  be  found  from  maximum 
mean-square  values  of  the  regulated  state 
variables,  but  does  not  satisfy  the  assignability 
conditions,  then  one  should  be  able  to  find  an 
assignable  covariance  that  is  close  in  some  sense 
to  the  desired  covariance.  This  implementation 
issue  and  others  like  the  numerical  generation  of 
all  assignable  covariances  for  a  given  system 
have  been  the  subject  of  recent  research 
(Grigoriadis  and  Skelton,  1992)  and  positive 
results  will  be  made  available  soon. 
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NEW  SPACE  STRUCTURE  AND  CONTROL  DESIGN 
CONCEPTS 

Purdue  University  Space  Systems  Controi  Lab 
AFOSR  Grant  No.  F49620-92-J-0202: 


PURDUE  ALGORITHM  FOR  STRUCTURE/CONTROLLER 
DESIGN: 

•  MOWOTO/V/CAL/.V' CONVERGENT  ALGORITHM 

•  GUARANTEES  GLOBAL  OPTIMAL  SOLUTION  TO  THE 

SIMULTANEOUS  STRUCTURE/CONTROL  REDESIGN  (WITH 
LINEAR  PARAMETERS) 

•  PARAMETRIZES  ALL  STABILIZING  COMBINATIONS  OF 
PASSIVE  AND  ACTIVE  CONTROL 

•  OPTIMIZES  THE  DISTRIBUTION  OF  MASS,  STIFFNESS  AND 
DAMPING  WITHIN  A  CONTROLLED  STRUCTURAL  SYSTEM, 
TO  SATISFY  DYNAMIC  RESPONSE  CONSTRAINTS  ON: 

•  OUTPUT  RMS  VALUES 

•  OUTPUT  PEAK  VALUES  IN  TIME  (WITH  UNKNOWN 
BUT  ENERGY  BOUNDED  DISTURBANCES) 

•  STABILITY 


Current  Applications:  The  Phillips  Lab  Laser  Crosslink 
Structure  9i 


